Stack Overflow
Stack Overflow

Questions tagged [s3cmd]

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

See the s3cmd homepage for more information.

282 questions
0
votes
1 answer

When to use s3cmd over accessing the S3 API programmatically?

I've been having difficulty understanding when to use s3cmd program over using the Java API. A vendor has documentation on accessing S3 with s3cmd. It is unclear to me as the bucket names appear to be dynamic. No region is specified. Additionally,…
Albert
  • 420
  • 1
  • 6
  • 17
0
votes
0 answers

How do I install s3cmd on MSYS2?

I'd like to install s3cmd in a "clean" way on MSYS2 running on Windows. But when I run pacman -S s3cmd nothing happens. On the other hand, I see that s3cmd has been packaged for ArchLinux, the Linux distribution on which MSYS2 is…
lindelof
  • 34,556
  • 31
  • 99
  • 140
0
votes
0 answers

Access bucket using S3cmd with IAM role

I have the following configured in ~/.aws/config file. [profile profilename] role_arn = arn:aws:iam::106546725123:role/rolename credential_source = Ec2InstanceMetadata i can successfully access an s3 bucket using aws CLI with the below command aws…
user3435047
  • 97
  • 12
0
votes
0 answers

Exclude sub-folder for Sync to AmazonS3 using s3cmd

I am using the following command with s3cmd to sync a wordpress wp-content folder to S3 /usr/bin/s3cmd sync -r --delete-removed --add-header "Cache-Control:max-age=31536000" /home/USERNAME/public_html/wp-content/…
Chad Warren
  • 107
  • 2
  • 17
0
votes
2 answers

Region conflict in AWS S3

I have bucket in the region EU (London) in S3. I am trying to upload a tar file through command line. At the end it throws an error saying so A client error (PermanentRedirect) occurred when calling the PutObject operation: The bucket you are…
darshan krishnaiah
  • 111
  • 3
0
votes
0 answers

What does "-" (dash) means in bash?

I ran the following command that I found on internet. s3cmd ls --recursive s3://bucket/files | awk '{print $4}' | xargs -I@ s3cmd get @ - a) Can anyone break this down from the xargs part b) I specifically want to know what does "-" means in…
Sarbjit
  • 33
  • 2
  • 10
0
votes
1 answer

Directory names causing errors when setting bucket contents to public?

I am using s3cmd (version 2.0.1) to set all the contents of a bucket/directory as public, but I can't set the object's acl as public for directories named with all lower case characters. I can only set the bucket contents as public if the bucket…
blaylockbk
  • 2,503
  • 2
  • 28
  • 43
0
votes
1 answer

Looking for AWS CLI equivalent for s3cmd --delete-removed

I'm moving from s3cmd tool to the official aws CLI tool distributed by Amazon, and as I'm converting old scripts, I'm curious about how to construct this equivalent command: s3cmd --delete-removed sync s3://$BUCKET $LOCAL_DIR/ From the s3cmd…
codeadventurer
  • 611
  • 2
  • 8
  • 17
0
votes
0 answers

S3cmd not updating existing files in Amazon S3

I am running this script via a daily cronjob to backup a wordpress site to Amazon S3 * 4 * * * /root/s3backyupsync.sh > /dev/null 2>&1 Contents of .sh script #!/bin/bash ################################################ # Simple script to…
JoaMika
  • 1,727
  • 6
  • 32
  • 61
0
votes
1 answer

Cronjob error - s3cmd - No such file or directory

I am in the process of setting up a wordpress/woocommerce site on AWS with a CloudFront CDN however I am unable to get the cronjob push to S3 working. I am using the stock bitnami wordpress AMI and have installed s3cmd. Using s3cmd I have been able…
tjrburgess
  • 757
  • 1
  • 8
  • 18
0
votes
0 answers

Using S3Tools Client Side Encryption and Copy from S3 to Redshift

I am using the S3cmd put with an -e flag to encrypt a file. When I try to copy the file to Redshift (from S3) I get an error. I am using my passphrase converted to AES256 as my master key. copy xxx from 'xxx' access_key_id 'xxx' secret_access_key…
whendatafails
  • 1
0
votes
0 answers

403 (Forbidden) when doing `s3cmd get` but `s3cmd ls` works

I've set up s3cmd and can successfully put an encrypted file on S3 using it by doing this: $ s3cmd put --encrypt --config=/home/phil/.s3cfg s3://my-bucket-name/my-dir/my-filename The file is put there OK. But when I try to get the file, this…
Phil Gyford
  • 13,432
  • 14
  • 81
  • 143
0
votes
1 answer

Is it possible to interact via s3cmd with a single node deployment of OpenStack Swift

I deployed the storage service OpenStack Swift ontop of a Raspberry Pi 3 with Raspbian = Debian Jessie 8.0. (Thanks to Swift on Pi, the installation was no a big issue). $ curl -i -H "X-Auth-User: test:tester" -H "X-Auth-Key: testing"…
Neverland
  • 773
  • 2
  • 8
  • 24
0
votes
1 answer

getting error while using s3cmd with following config

I am trying s3cmd from command line and when i am configuring using s3cmd --configure following lines of information its asking me. I know I am giving proper Access Key and Secret key. But I think the problem is with Default Region: Mumbai or S3…
Rahul Shrivastava
  • 1,391
  • 3
  • 14
  • 38
0
votes
1 answer

Unable to use filename wildcards with s4cmd when trying to copy or sync from Amazon S3

I'm trying to use s4cmd to copy files from an AWS S3 bucket using wildcards which are supposedly supported. For example, I wanted to sync all AWS S3 log files starting with 2017-03-12 to my local current directory: s4cmd sync…
Howiecamp
  • 2,981
  • 6
  • 38
  • 59
1 2 3
…
18 19