I have a large number of files stored in an AWS S3 bucket. I need to get those files to another S3 bucket owned by another user and in a different region. The files are stored in different locations within my S3 bucket--these keys (e.g. location1
& location2
) need to transfer over too. Both S3 buckets are associated with AWS EC2 Ubuntu Servers. Here is an example of the structure of my S3 bucket:
s3://mybucket/location1/some_file
s3://mybucket/location1/some_file2
s3://mybucket/location2/some_file
etc...
What approach to transfer files from S3 to S3 would be most efficient given these constraints?