Stack Overflow
Stack Overflow

Questions tagged [s3cmd]

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

See the s3cmd homepage for more information.

282 questions
0
votes
1 answer

's3cmd sync' is working but not 'aws s3 sync'

I have an EC2 instance in which I want to download a file. I could able to download using s3cmd command s3cmd sync s3:///filename /tmp 100% downloaded But, using the 'asw s3 sync' it is not working, aws s3 sync…
Balasekhar Nelli
  • 1,177
  • 4
  • 18
  • 30
0
votes
1 answer

Crontab doesn't parse "date" command

I'm trying to schedule this command on crontab 00-59/1 * * * * s3cmd put $HOME/www/database.db s3://Solenoide/`date +%Y-%m-%d_%H-%M-%S`.db It's a backup to AWS S3 using s3cmd. The command runs fine when I execute it on the terminal (Ubuntu 14.04…
Vini.g.fer
  • 11,639
  • 16
  • 61
  • 90
0
votes
2 answers

how to move files from remote server to s3 at the command line

I have a lot of big files on a remote server and I want to move them into S3. I want to do it at the command line or with a bash script (e.g., I do NOT want to use a gui app like cyberduck) so that I can automate/replicate efforts. I have tried…
ansonw
  • 1,559
  • 1
  • 16
  • 22
0
votes
1 answer

s3cmd sync move two buckets into a single bucket

I attempted to do it with the sync command but it tries to delete files from the target bucket that aren't in the source bucket. how can i move two buckets into one bucket with s3cmd? The situation is that i set it up with the idea that we would use…
r3wt
  • 4,642
  • 2
  • 33
  • 55
0
votes
0 answers

How to convert AWS sync command using s3cmd

How can I convert the following command and use s3cmd instead? aws s3 sync ./test s3://test --content-encoding "gzip" --content-type "text/html" --cache-control "max-age=0, no-cache" --exclude "*" --include "index.html" --profile stage I want to…
Chris Hansen
  • 7,813
  • 15
  • 81
  • 165
0
votes
3 answers

s3cmd : copy file from encrypted buckets in s3 to local machine

I want to download a file from an encypted bucket in s3. The bucket is encrypted using AES256. I am using the following command s3cmd --access_key= --secret_key= get . I read the s3 usage. It…
Nitin Pandey
  • 649
  • 1
  • 9
  • 27
0
votes
1 answer

How to transform unicode filenames when running s3cmd under OS X

Is there any way to correctly upload unicode filenames to S3 using s3cmd from an OS X machine? The problem is the following: OS X uses NFD filenames, Linux/BSD and Amazon uses NFC (for static file serving). When using rsync, I can specify the…
hyperknot
  • 13,454
  • 24
  • 98
  • 153
0
votes
2 answers

Is there any way to specify a max number of retries when using s3cmd?

I've looked through the usage guide as well as the config docs and I'm just not seeing it. This is the output for my bash script that uses s3cmd sync when S3 appeared to be down: WARNING: Retrying failed request: /some/bucket/path/ WARNING: 503…
Matt Vukas
  • 3,225
  • 3
  • 26
  • 37
0
votes
2 answers

Does sync s3 to s3 works in s3cmd version 1.1.0-beta3

Does sync s3 to s3 works in s3cmd version 1.1.0-beta3 ? # s3cmd --version s3cmd version 1.1.0-beta3 Getting following error : # s3cmd sync --exclude 'reportTemplate/*' 'orders/*' 'customers/*' s3://xxx-storage-bucket-prod-env/…
Ashish Karpe
  • 5,087
  • 7
  • 41
  • 66
0
votes
1 answer

Can't use sync to move objects in a folder to another folder within the same bucket using s3cmd

I have been trying to move all the objects in a folder bucketA/product/pic/ up one level within the same bucket bucketA/pic/ I can sync files between local host and the s3 server with s3cmd sync /script/ s3://bucketA/ as well as put an…
RedGiant
  • 4,444
  • 11
  • 59
  • 146
0
votes
2 answers

Unable to Sync to S3 with s3cmd

After setting up s3cmd and my S3 bucket, when I try this command sudo s3cmd sync --recursive --preserve /srv s3://MyS3Bucket I get this error: ERROR: S3 error: 400 (InvalidRequest): The authorization mechanism you have provided is not supported.…
Saurabh Vashist
  • 129
  • 1
  • 2
  • 7
0
votes
1 answer

Encrypt file with 256 bit AES key from s3cmd tool

I've got a bucket with some amount of unencrypted files, I need to encrypt them with 256 bit AES key. I've already written a java code to encrypt those files and it is working fine. What I am wondering is if the s3cmd tool provided also supports the…
thickGlass
  • 540
  • 1
  • 5
  • 19
0
votes
1 answer

S3cmd configuration not working properly ERROR: S3 error: None

I am trying to install s3cmd in centos with below configuration. But when i try to list down all buckets it give error s3cmd ls ERROR: S3 error: None I have checked python version is 2.6.6 and s3cmd version 1.5.1.2…
Jackson Harry
  • 308
  • 1
  • 2
  • 15
0
votes
1 answer

Getting error while configuring s3cmd

Configuring s3cmd via s3cmd --configure is failing even after providing the correct access credentials. The error that is thrown up is ERROR: S3 error: Access Denied. I am using version 1.5.2, downloaded via pip. The Default Region is set to US, but…
user2122377
  • 23
  • 2
  • 4
0
votes
1 answer

Simultaneous public and private credential access

I have received a username, access key ID, and secret access key ID for a public dataset on Amazon S3 (public for authorised users). I have been using s3cmd with my private account and S3 buckets. How can I configure s3cmd so that at the same time I…
Arman
  • 927
  • 3
  • 12
  • 32
1 2 3
…
18 19