Stack Overflow
Stack Overflow

Questions tagged [s3cmd]

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

See the s3cmd homepage for more information.

282 questions
1
vote
2 answers

S3 console Copy/Paste forbidden after s3cmd PUT from another account

Let's say i have 2 aws accounts: Account1 and AccountZ I installed and configured s3cmd to have access to Account1. I created a bucket in AccountZ and made it publicly read/write I performed an s3cmd put of a text.txt from Account1 to…
Kristian
  • 21,204
  • 19
  • 101
  • 176
1
vote
1 answer

Create and upload tar.gz to S3 bucket

I have a post-receive shell script as such: #!/bin/bash TGZNAME=imprv`date +%s`.tar.gz TGZPATH=/var/git_out/imprv/ TGZFULL=$TGZPATH$TGZNAME S3BUCKET=my-s3-bucket S3PATH=s3://$S3BUCKET/imprv/ git --work-tree=/var/git_out/imprv/imprv…
Bernard Lechler
  • 277
  • 6
  • 19
1
vote
1 answer

Uploading css files using s3cmd sync fails

Trying to upload files to s3 bucket using this command s3cmd -c sync -P -M dist/public/angular/styles/* s3://bucket/styles/ Getting this error ERROR: Error parsing xml: not well-formed (invalid token): line 4, column 4 ERROR: 503 Service…
Godfrey Fernandes
  • 139
  • 1
  • 10
1
vote
1 answer

Does s3cmd sync count each file against list or put request pricing

I'm using s3cmd to send compressed backup of accounts (shared hosting server) to S3. I'm thinking that aside from sending compressed backup. I can optionally backup my enter server to S3 and synchronize it periodically to keep the backup updated.…
Marlon Owen Cruz
  • 11
  • 3
1
vote
1 answer

s3cmd add lifecycle rule for object in bucket

I am using s3smd package in ubuntu for uploading files on aws. Now i want to add lifecycle rule for different objects inside bucket. I can see the commands from http://s3tools.org/usage According to s3cmd git…
NeiL
  • 791
  • 8
  • 35
1
vote
1 answer

Error While Try To Install s3cmd Tool for S3

I am actually trying to install s3cmd tool that has been cloned from git. I have python 3 installed on my node and it looks while trying to install it gives some Error :: [root@linux s3cmd]# /opt/python3/bin/python3 setup.py install File…
Amit
  • 123
  • 1
  • 8
1
vote
2 answers

Can't get public bucket using Ceph API

I create public bucket from S3 client using comand: s3cmd mb s3://public_bucket --acl-public Bucket 's3://public_bucket/' created I can see this bucket from client(s3cmd ls) and from rados gw (using radosgw-admin bucket list). But when I use the…
bayrinat
  • 1,468
  • 8
  • 18
1
vote
2 answers

s3cmd copy removes metadata, how do you maintain?

I am using the Website Redirect Location feature of S3s web hosting. The architecture uses a bucket for the production www (www) site, and a bucket (redirects) for legacy 301 redirects that have been recreated as directories+files in S3, then…
Joshua Levy
  • 23
  • 3
1
vote
2 answers

Which version of s3cmd does support IAM Roles?

I am using latest version of s3cmd 1.5.2. As per this post, 1.5.0-alpha2 supports IAM Roles, so I am assuming this must be supported in 1.5.2 as well. I added "security_token" in s3cfg file as mentioned in this post. But I am still getting error…
Yogesh
  • 83
  • 2
  • 7
1
vote
1 answer

Error uploading small files to s3 using s3cmd?

I am having an unusual error: my files appear to be too small to be uploaded to s3! I have a small log file which is not uploading: s3cmd put log.txt s3://MY-BUCKET/MY-SUB-BUCKET/ ERROR: S3 error: Access Denied But when I do this: yes | head -n…
mgoldwasser
  • 14,558
  • 15
  • 79
  • 103
1
vote
1 answer

Why does s3cmd du give different results depending on slash at end of path?

s3cmd du -H s3://bucketabc/prefix/further-prefix gives 21G s3cmd du -H s3://bucketabc/prefix/further-prefix/ gives 10G. There are no files directly in there, just four "subdirectories." I have five buckets which are near-copies and this only…
Joshua Fox
  • 18,704
  • 23
  • 87
  • 147
1
vote
0 answers

s3cmd - uploading from centos linux machine - access denied

I have been trying to do this simple thing of copying a file from my centos linux machine (outside AWS) to S3 bucket. I wanted it simple - have followed below steps - 1) Created S3 bucket 2) Created IAM user and assigned a policy to give full rights…
MWM
  • 43
  • 1
  • 4
1
vote
1 answer

s3cmd pipe mongodb 3.0.2 SASL auth failed

Does anybody experience an issue with s3cmd and mongoimport after having upgraded to mongodb 3.0.2? I am receiving the SCRAM-SHA1 / SASL error but have no clue how I can fix this? The connection from and to s3 is still unaffected and working…
LJM JR
  • 43
  • 1
  • 7
1
vote
2 answers

Exclude specific files from S3 Cross-Region Replication

I was wondering if there was a way to exclude specific files from S3 Cross-Region Replication. I am aware of the prefix option, but I have a cache folder within my bucket that I don't want to include. Example: I want to include the…
APO
  • 46
  • 6
1
vote
2 answers

Root user is denied downloading from s3 bucket

Using s3cmd after configuring with my root privileges (access key and secret key), whenever I try to download something from a bucket using sync or get , I receive this strange error of permission for my root account: WARNING: Remote file S3Error:…
Arman
  • 927
  • 3
  • 12
  • 32
1 2 3
…
18 19