As an alternative to s3cmd
, aws-cli
- you might consider using https://github.com/minio/mc
mc
implements mc mirror
command to recursively sync files and directories to multiple destinations in parallel.
Features a cool progress bar and session management for resumable copy/mirror operations.
$ mc mirror
NAME:
mc mirror - Mirror folders recursively from a single source to many destinations.
USAGE:
mc mirror SOURCE TARGET [TARGET...]
EXAMPLES:
1. Mirror a bucket recursively from Minio cloud storage to a bucket on Amazon S3 cloud storage.
$ mc mirror https://play.minio.io:9000/photos/2014 https://s3.amazonaws.com/backup-photos
2. Mirror a local folder recursively to Minio cloud storage and Amazon S3 cloud storage.
$ mc mirror backup/ https://play.minio.io:9000/archive https://s3.amazonaws.com/archive
3. Mirror a bucket from aliased Amazon S3 cloud storage to multiple folders on Windows.
$ mc mirror s3/documents/2014/ C:\backup\2014 C:\shared\volume\backup\2014
4. Mirror a local folder of non english character recursively to Amazon s3 cloud storage and Minio cloud storage.
$ mc mirror 本語/ s3/mylocaldocuments play/backup
5. Mirror a local folder with space characters to Amazon s3 cloud storage
$ mc mirror 'workdir/documents/Aug 2015' s3/miniocloud
Hope this helps.