2

I have a requirement where we need to move files from on-prem NAS storage to AWS S3. Files keep coming on NAS storage when it arrives we have notification set up in AWS and then we need to pull files from AWS to S3.

  1. Can I access NAS storage and pull files from AWS to S3?
  2. Does it require any additional configuration or simple EC2 or Lambda function can work based on size of the file?
  3. How about NAS --> SFTP --> S3 using AWS Transfer family solution.
  4. Is there any better way to move files from NAS to S3?

We want to avoid writing code as much as we can.

jarmod
  • 71,565
  • 16
  • 115
  • 122
Sudarshan kumar
  • 1,503
  • 4
  • 36
  • 83

1 Answers1

1

You should take a look at AWS Datasync. It is a data transfer service of AWS that allow to copy data to and from AWS storage services over the Internet or over AWS Direct Connect (protocols NFS, SMB).

You don't need EC2 or AWS lambda. You have to install an agent that will read from a source location, and sync your data to S3. The agent is deployed on-premise. Please find the supported Hypervisor here: https://docs.aws.amazon.com/datasync/latest/userguide/agent-requirements.html and the deployment guide here: https://docs.aws.amazon.com/datasync/latest/userguide/deploy-agents.html

veben
  • 19,637
  • 14
  • 60
  • 80
  • 1
    I think you mixed your URL. Datasync is [here](https://aws.amazon.com/datasync/). – Mornor Nov 23 '21 at 15:55
  • Thanks @Mornor, I edited the answer – veben Nov 23 '21 at 16:32
  • Thanks for the answer ...So this agent will be deployed on prem server ? – Sudarshan kumar Nov 24 '21 at 04:28
  • 1
    @SUDARSHAN, yes the agent is deployed on-premise. Please find the supported Hypervisor here: https://docs.aws.amazon.com/datasync/latest/userguide/agent-requirements.html and the deployment guide here: https://docs.aws.amazon.com/datasync/latest/userguide/deploy-agents.html – veben Nov 24 '21 at 06:56
  • @Sudarshankumar , How you manged to sync files data arrives daily once done with data sync operations ? – dEL Apr 10 '23 at 16:19