S3 Batch operation is slow for copying s3 objects

Asked Mar 24 '21 at 09:22

Active Mar 24 '21 at 09:22

Viewed 433 times

I am trying to copy objects b/w s3 buckets using S3 batch operation. Both buckets are in same region but different account. I followed this blog and set up the inventory/role/policies.

S3 batch operation blog

I found that S3 batch operation is dead slow. Below is my source bucket stats:

Bucket size: 2.7 TB.

Number of objects: 169 Million

In 14 hours, it copied only 20% objects

Any help is really appreciated.

asked Mar 24 '21 at 09:22

Kapil

if this works https://stackoverflow.com/q/39149171/13126651 – Jatin Mehrotra Mar 24 '21 at 09:33
You can also use [S3 replication for exisiing objects](https://aws.amazon.com/blogs/storage/replicating-existing-objects-between-s3-buckets/). – Marcin Mar 24 '21 at 11:40

S3 Batch operation is slow for copying s3 objects

0 Answers0