Questions tagged [s3cmd]

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

See the s3cmd homepage for more information.

282 questions
0
votes
1 answer

How to import dependencies in Git

I have a project and I want to push it on Git. But locally, my project has some dependencies to RDSCLI (Amazon RDS Command Line Toolkit) and s3cmd. So how do I make sure that if anyone wants to use my project do not have to bother about downloading…
user95025
  • 175
  • 3
  • 10
0
votes
1 answer

s3cmd: backup folder to Amazon S3

I'm using s3cmd to backup my databases to Amazon S3, but I'd also like to backup a certain folder and archive it. I have this part from this script that successfully backups the databases to S3: # Loop the databases for db in $databases; do #…
Max
  • 841
  • 1
  • 12
  • 25
0
votes
2 answers

s3cmd: how to use server side encryption?

I'm trying to encrypt some files on Amazon S3 using server side encryption. According to this link http://s3tools.org/kb/item9.htm I should only add this flag --server-side-encryption on the put or sync command I'm trying to run, but when I do…
Vini.g.fer
  • 11,639
  • 16
  • 61
  • 90
0
votes
0 answers

How to delete 7 days old backup files from s3 keeping only one file?

I am taking and uploading mongodb backup on s3 every two hours with cron. 17 */2 * * * Now I want to keep all files of last 7 days, and want to delete all files from s3 after 7 days but want to keep one backup for 1 day. I am using S3cmd. How can I…
Alpesh
  • 107
  • 8
0
votes
2 answers

Unable to use encrypt option on s3cmd

I have two simple scripts to upload and download some code to and from S3 on Amazon web services: #####Upload Script zip -r file.zip www s3cmd del s3://mybucket/file.zip --encrypt s3cmd put file.zip s3://mybucket --encrypt rm -rf…
Vini.g.fer
  • 11,639
  • 16
  • 61
  • 90
0
votes
1 answer

s3cmd Put file with spaces on their names

I´m getting a problem to put or sync files to a bucket with spaces on their names. The program freezes, no error messages are showed or logged. ...
Celso Marigo Jr
  • 656
  • 1
  • 14
  • 35
0
votes
0 answers

Email when shell_exec is finished

I am executing s3cmd command with shell_exec in php. Everything is working fine . Only thing is how to send an email when the s3cmd process is finished. I am trying the below code shell_exec('export HOME="";s3cmd -c /home/.s3cfg ls email@yahoo.com…
Anish
  • 4,262
  • 6
  • 36
  • 58
0
votes
3 answers

How to upload multiple files(20K+) to AWS S3

How to upload multiple files to AWS S3? I tried two ways and both failed: 1)s3cmd shows following error even the file is only 270KB. $s3cmd put file_2012_07_05_aa.gz s3://file.s3.oregon/ file_2012_07_05_aa.gz ->…
Haifeng Zhang
  • 30,077
  • 19
  • 81
  • 125
0
votes
0 answers

Trigger a command in ubuntu/linux whenever a new file is created in a directory

How could I trigger a command in ubuntu/linux, whenever a new file is created in a directory by a Java webapp ? Usage/Context: I need to move a newly created file (created by java app), in a directory to amazon s3 using s3cmd command.
Rajat Gupta
  • 25,853
  • 63
  • 179
  • 294
0
votes
1 answer

s3cmd put -preserve flag does not preserve file creation /Modified date when copied to s3 bucket

I am copying files for AWS ec2 to AWS s3 bucket, with --preserver flag to preserver to file create and modified date, but once file is copied to s3bucket, "s3cmd ls s3://bucket-name/" command list the file upload time as file time, it does not…
user2812866
  • 589
  • 1
  • 5
  • 15
0
votes
1 answer

How disable multipart upload so sync matches the md5sum of local and remote file in s3cmd

How disable multipart upload so sync matches the md5sum of local and remote file in s3cmd. When I upload a large file, s3cmd separates the file into parts. The eTag on Amazon S3 is the last part of the multipart. How can I preserve the file uploaded…
Marvado
  • 331
  • 1
  • 3
  • 11
0
votes
2 answers

filtered results with s3cmd get

I'm using cmd tool for AWS S3 called s3cmd. I'm trying 'get' set of folders filtered by front part of name directory name like '/192.168.*/'. Basically I have S3 bucket with a lot of directories and I just need couple of them that start with…
lukabix22
  • 85
  • 1
  • 1
  • 4
0
votes
1 answer

system s3cmd sync php timeout

I am trying to sync folders between my remote server and amazon s3 using the system command through a php web page. The web page has option to browse the folder which need to sync between the server and s3 The s3 command is the below one …
Anish
  • 4,262
  • 6
  • 36
  • 58
0
votes
1 answer

Preventing a program from breaking my Bash script

I'm using S3cmd in a bash script upon startup. If it returns an error code, the script is ready to do something. However, s3cmd seem to (sometimes) break it all when an error occurs, and outputs information on screen. It just exists my script. How…
Paolo
  • 2,161
  • 5
  • 25
  • 32
0
votes
1 answer

s3cmd incomplete format error

When I run $ s3cmd I get !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! An unexpected error has occurred. Please report the following lines to: s3tools-bugs@lists.sourceforge.net !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Problem: ValueError:…
equivalent8
  • 13,754
  • 8
  • 81
  • 109
1 2 3
18
19