Stack Overflow
Stack Overflow

Questions tagged [s3cmd]

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

See the s3cmd homepage for more information.

282 questions
1
vote
1 answer

Bash glob pattern being expanded using remote data

I have done this by mistake: s3cmd del s3://mybucket/* But ... it is working: ... delete: 's3://mybucket/file0080.bin' delete: 's3://mybucket/file0081.bin' delete: 's3://mybucket/file0082.bin' ... I am baffled. Usually * is expanded by the shell…
blueFast
  • 41,341
  • 63
  • 198
  • 344
1
vote
1 answer

Multiple lifecycles s3cmd

I want to have multiple lifecycles for many folders in my bucket. This seems easy if I use web interface but this should be an automated process so, at least in my case, it must use s3cmd. It works fine when I use: s3cmd expire ... But, somehow,…
Pedro Caldeira
  • 124
  • 2
  • 13
1
vote
3 answers

Digital Ocean Spaces | Add expire date for files with s3cmd

I try add expire days to a file and bucket but I have this problem: sudo s3cmd expire s3:/// --expiry-days=3 expiry-prefix=backup ERROR: Error parsing xml: syntax error: line 1, column 0 ERROR: not found ERROR: S3 error: 404 (Not…
Dmytro
  • 61
  • 2
  • 13
1
vote
0 answers

LeoFS returns a nodedown error but the node appears to be running

I am running leofs 1.2.22 on a single node. Everything was working ok but when I started leofs today I am unable to list the contents of any buckets. I am getting errors stating the node is down. A leofs-adm status shows $ leofs-adm status [System…
Simon Reynolds
  • 11
  • 1
1
vote
0 answers

s3cmd not excluding a chosen prefix when restoring from Glacier

What am I doing I am trying to Glacier-restore all objects under the kevinturino.com prefix in my s3 bucket named simplewebsite. I want the prefix kevinturino.com/plugins to be excluded. What is happening? The kevinturino.com/plugins prefix is not…
Felipe Alvarez
  • 3,720
  • 2
  • 33
  • 42
1
vote
1 answer

Unable to exclude directories from s3cmd sync

I'm having an issue excluding directories on a nightly backup script using S3cmd. I'm trying to exclude certain files from being backed up (log files, etc...) My server structure is: /srv/users/USERNAME/ /srv/users/USERNAME2/ etc... So I'm running…
nocabt
  • 1,112
  • 11
  • 11
1
vote
1 answer

s3cmd reads configuration file but claims it doesn't exist

I'm using s3cmd to access the Ceph storage provided by my cloud provider. I created a minimal .s3cfg file on my VM to do so. When I try to list buckets, it claims that it can't find the configuration file despite --debug output showing that it's…
Bruno Girin
  • 175
  • 2
  • 10
1
vote
1 answer

Amazon S3 Object Lifecycle Management via header

I've been searching for an answer to this question for quite some time but apparently I'm missing something. I use s3cmd heavily to automate document uploads to AWS S3, via script. One of the parameters that can be used in s3cmd is --add-header,…
t988GF
  • 183
  • 7
1
vote
1 answer

How do I configure s3cmd from Ansible?

I have a playbook which clones a repo and executes a Python script, which uses s3cmd and os.popen() to run an s3cmd command. However, it says s3cmd: command not found, even though I have installed s3cmd. Maybe it is because I have not configured…
Dawny33
  • 10,543
  • 21
  • 82
  • 134
1
vote
1 answer

S4cmd giving permission denied error

I installed S4cmd on my Ec2 Ubuntu instance, but when trying to run it was giving this below error:-bash: /usr/local/bin/s4cmd: Permission denied I tried everything like sudo -s, updating pip & everything advised in other questions. But none of…
Avinash
  • 33
  • 1
  • 1
  • 6
1
vote
1 answer

Any examples of s3cmd put with --files-from argument

I am trying to use s3cmd put using the --files-from argument as follows: s3cmd --progress put --files-from=list_of_files_to_upload_to_s3.txt s3://softwares/backup/packages/ But am getting a ERROR: Not enough parameters for command 'put'. Are there…
ossandcad
  • 778
  • 5
  • 18
1
vote
1 answer

restore with s3cmd file from Glacier - ERROR: S3 error: 403 (Forbidden)

Info about my bucket and the object s3cmd info s3://$BUCKET/ s3://$BUCKET/ (bucket): Location: eu-central-1 Payer: BucketOwner Expiration Rule: all objects in this bucket will expire in ' policy: none cors: none ACL: …
Sybil
  • 2,503
  • 3
  • 25
  • 36
1
vote
1 answer

s3cmd with OpenPGP encryption key - is this a password or a passphrase?

I setup a 10 char complex password for GnuPG with s3cmd. Run s3cmd --configure You will be asked for the two keys - copy and paste them from your confirmation email or from your Amazon account page. Be careful when copying them! They are case…
Sybil
  • 2,503
  • 3
  • 25
  • 36
1
vote
1 answer

s4cmd sync two buckets access denied

I am trying to sync two s3 buckets: s4cmd --dry-run sync s3://cgl-rnaseq-recompute-fixed/gtex s3://rnaseq.toil.20k/gtex But I am getting the following error: [Exception] An error occurred (AccessDenied) when calling the ListObjects operation:…
Komal Rathi
  • 4,164
  • 13
  • 60
  • 98
1
vote
2 answers

Automatic backup from s3 to another server or cloud

I am using s3cmd to backup my files from s3, I run the following command from my terminal to sync between my files in my_bucket and my local folder called workfiles which is in the home directory s3cmd sync s3://my_bucket/ /home/mody/workfiles/…
medBouzid
  • 7,484
  • 10
  • 56
  • 86
1 2 3
…
18 19