Stack Overflow
Stack Overflow

Questions tagged [s3cmd]

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

See the s3cmd homepage for more information.

282 questions
1
vote
1 answer

Can s3cmd or AWS CLI read object metadata?

Setting metadata via HTTP headers using s3cmd is straightforward enough: $> s3cmd put --add-header=x-amz-custom-header:true file.txt s3://bucket/ However, it looks like there's no way to read these headers (or some of Amazon's default immutable…
biegel
  • 570
  • 5
  • 12
1
vote
1 answer

bash & s3cmd not working properly

Hi I have a shell script which contains s3cmd command on ubuntu 12.04 LTS. I configured cron for this shell script which works fine for local environment but don't push the file to s3. But when i run shell script manually, It pushes the file to s3…
Shailesh Sutar
  • 370
  • 1
  • 6
  • 22
1
vote
0 answers

s3cmd sync not working from php system() while from shell it is

Im trying to run a .sh script that contains "s3cmd sync.." command and it is not working. When running the same sh from shell prompt it works perfect. It seems that the execute permissions for s3cmd are insufficient when running from php system /…
user3112889
  • 11
  • 4
1
vote
4 answers

s3cmd to set correct content type for image/jpeg

I have uploaded a number of directories that contain images, what is the correct way to modify the content-type to "image/jpeg" without having to re-upload the images? I tried: s3cmd modify s3://ccc-public/catalog/cropped/EP01L.jpg…
khinester
  • 3,398
  • 9
  • 45
  • 88
1
vote
1 answer

Correct permissions for AWS remote copy

I'm using s3tools to sync files on a server and an s3 bucket. Specifically, I'm using the sync command. This, however, is not working correctly because I can't find the right permissions to assign to the user I've setup. Almost everything seems to…
fraxture
  • 5,113
  • 4
  • 43
  • 83
1
vote
1 answer

Moving files within amazon s3 bucket

I have uploaded files on s3 bucket. But due to my fault, s3cmd uploaded files on s3://backups/files/bkup14 instead of s3://backups/bkup14. Now for moving all the files under s3://backups/files/bkup14 to s3://backups/bkup14, I tried below…
Parth Patel
  • 91
  • 1
  • 6
1
vote
1 answer

Setup Amazon S3 backup on QNAP using s3cmd

I own a QNAP-219P and I want to set this up manually using s3cmd. I did quite a bit of research on this, and here are the references I…
Thomas Cheng
  • 695
  • 12
  • 26
1
vote
2 answers

How to upload to compress and upload to s3 on the fly with s3cmd

I just found my box has 5% for HDD hard drive left and I have like almost 250GB of mysql bin file that I want to send to s3. We have moved from mysql to NoSQL and not currently using mysql. However I would love to preserve old data before…
black sensei
  • 6,528
  • 22
  • 109
  • 188
1
vote
1 answer

set Expiry Date S3 AWS cloud front, update with s3cmd

i have uploaded to s3 images for my website and now i want to update the Expiry Date recursively. i have used the following command: s3cmd --recursive modify --add-header="Cache-Control:max-age=31536000" s3://ccc-public/ but when i view the image…
khinester
  • 3,398
  • 9
  • 45
  • 88
1
vote
2 answers

Can s3cmd be used to download a file and upload to s3 without storing locally?

I'd like to do something like the following but it doesn't work: wget http://www.blob.com/file | s3cmd put s3://mybucket/file Is this possible?
user2395365
  • 1,991
  • 4
  • 18
  • 34
1
vote
3 answers

Calling bash command with If/Else and awk

I'm looking to GET all files on my S3 bucket that are larger than 200 KB. After some research, I'm able to recursively generate a list of all files in my S3 bucket that are larger than 200 KB, with the following command: s3cmd ls -r s3://mybucket |…
fhbi
  • 722
  • 7
  • 17
1
vote
3 answers

Big data zip on amazon S3 files

I have large amount of data stored on amazon S3 in the forms of objects. like i Have user which have 200+ GB of photos (about 100000+ objects) stored on amazon S3. each object is a photo , each object size is average 5MB. Now I want to give a user…
Asghar
  • 2,336
  • 8
  • 46
  • 79
1
vote
2 answers

Fast way to get AWS S3 key count in bucket

Is there anyone out there knowing a fast way to get the count of my keys in S3? I usually do s3cmd ls s3://bucket/ | wc -l but my bucket contains a huge number of keys which makes this operation impossible to finish.
Vame
  • 2,033
  • 2
  • 18
  • 29
1
vote
2 answers

s3cmd tool on Windows server with progress support

As the title suggests, I am using the s3cmd tool to upload/download files on Amazon. However I have to use Windows Server and bring in some sort of progress reporting. The problem is that on windows, s3cmd gives me the following error: ERROR:…
stratis
  • 7,750
  • 13
  • 53
  • 94
1
vote
4 answers

How to run a python command from inside a python script?

I am running windows 7 x64 with python 2.7.6 and I just installed the s3cmd tool following these instructions: s3cmd win7 installation. The problem is that while I have both the python directory and the python scripts on my path, I can't run s3cmd…
stratis
  • 7,750
  • 13
  • 53
  • 94
1 2 3
…
18 19