Stack Overflow
Stack Overflow

Questions tagged [s3cmd]

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

See the s3cmd homepage for more information.

282 questions
0
votes
1 answer

Can't set Bucket Lifecycle Configuration

Doing this (aws-sdk ruby gem): s3_client.put_bucket_lifecycle_configuration({ bucket: bucket, lifecycle_configuration: { rules: [ { id: "clean-temporary", status: "Disabled", # required, accepts Enabled, Disabled …
yakimant
  • 85
  • 9
0
votes
1 answer

s3cmd sync S3 Error: 403 Access Denied

I was trying to do C:\Python27\python s3cmd sync -r K:\a\ s3://test-bucket/test/ on windows. It gives an error ERROR: S3 error: 403(Access Denied):Access Denied But the problem is on a different machine with same config for s3cmd, I can push any…
Sagar Grover
  • 65
  • 1
  • 9
0
votes
2 answers

BASH variable in string

This script1 is not working as intended. I will explain below: #!/bin/bash ### SETUP ### USER="MYUSER" DIRS="MYDIR" BUCKET="mybucket" DOACCESS="ACCESSKEY" DOSECRET="SECRETKEY" NAME="FILENAME" EXPIRE="7 days" NOW=$(date +"%d-%m-%Y") DAY=$(date…
TAG
  • 68
  • 1
  • 8
0
votes
1 answer

s3cmd 1.6 failed too many times

I have recently updated my s3cmd from 1.5 to 1.6. This is the error when I try to upload files of any size. I am using the same configuration as before. ERROR: Upload of ,' failed too many times (Last reason: Upload failed [1 of 1] …
Kaey
  • 4,615
  • 1
  • 14
  • 18
0
votes
1 answer

Issues with s4cmd

I have about 50GB data to upload to S3 bucket but s3cmd is unreliable and very slow. the sync doesn't seem to work because of the timeout error. I switched to s4cmd it works great, multi threaded and fast. s4cmd dsync -r -t 1000…
user1691915
  • 63
  • 2
  • 11
0
votes
2 answers

Pipe fswatch output into a shell script

I am trying to pipe the output of fswatch to several commands in a shell script with following technique: $ fswatch -0 [opts] [paths] | xargs -0 -n 1 -I {} [command] Instead of [command] I put the shell script path. Here is my command line: fswatch…
saltarob
  • 1
  • 3
0
votes
1 answer

s3cmd doesn't work with logrotate?

I imagine this is an issue with permissions, but I can't identify it. When you install s3cmd you have to configure it by running s3cmd --configure, which creates a config file at ~/.s3cfg. I've done this for user ubuntu. I can correctly put and get…
user1950164
0
votes
2 answers

Corrupted files when downloading large zip file from S3

I have a zip file with the size 1 GB on S3 bucket. After downloading, I can't seem to unzip it. It always says End-of-central-directory signature not found. Either this file is not a zipfile, or it constitutes one disk of a multi-part archive. In…
Oscar Yuandinata
  • 1,025
  • 1
  • 13
  • 31
0
votes
1 answer

's3cmd sync' only syncs files, does not recursively sync (FreeBSD py-s3cmd)

I have tried many dozens of variations to coax this utility into behaving as its documentation claims it will (FreeBSD 10, py-s3cmd). With this directory structure: A file1.txt + B + file2.txt According to the documentation and the man page, the…
Rjak
  • 2,097
  • 4
  • 19
  • 24
0
votes
1 answer

How To Set Name Of Target Folder on S3 with s3cmd

I have a server that holds 3 websites and I have the following bash script that will run the s3cmd sync command daily: #!/bin/sh echo 'Started' date +'%a %b %e %H:%M:%S %Z %Y' s3cmd sync --recursive --preserve /etc/apache2 s3://mybucket s3cmd sync…
mickburkejnr
  • 3,652
  • 12
  • 76
  • 109
0
votes
3 answers

s3 put json file access denied

I am using linux s3cmd to upload files to AWS S3. I can upload a zip file successfully and this has been working for months now, no problems. I now need to also upload a json file. When I try to upload the json file to the same bucket, I get S3…
user3720435
  • 1,421
  • 1
  • 17
  • 27
0
votes
1 answer

s3cmd obfuscate file names (change to random value) on Amazon S3 side (local original file name)

my .s3cfg with GPG encryption passphrase and other security settings. Would you recommend other security hardening? [default] access_key = $USERNAME access_token = add_encoding_exts = add_headers = bucket_location = eu-central-1 ca_certs_file =…
Sybil
  • 2,503
  • 3
  • 25
  • 36
0
votes
1 answer

Automated backup script via s3cmd and Python -- error handling?

I have a script that executes an s3cmd upload on a schedule. I have yet to encounter any errors in the upload process, but I anticipate I may run into one sometime in the future and would like to send an SNS notification if ever this happens. I know…
nnnm
  • 303
  • 4
  • 9
0
votes
1 answer

File with foreign characters downloaded from s3 using s3cmd is coming as?

I am trying to download a file from S3 using s3cmd command-line. The file is having foreign characters like (楽曲満載アプリ！！最新曲から懐かしの曲、気になるあの曲も検索できる). But when I download this file in my ubuntu machine and open the file, using vi command, the characters…
Sathiya Narayanan
  • 623
  • 6
  • 27
0
votes
2 answers

Getting "error s3cmd: command not found" while running it from script

Getting "error s3cmd: command not found" while running it from script in spite of installing it & setting environment variable. Also able to run s3cmd from command prompt ! Log : # tail -f…
Ashish Karpe
  • 5,087
  • 7
  • 41
  • 66
1 2 3
…
18 19