Stack Overflow
Stack Overflow

Questions tagged [s3cmd]

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

S3CMD QUESTIONS MUST BE PROGRAMMING RELATED. s3cmd is a command line tool for uploading, retrieving and managing data in Amazon S3. It is best suited for power users who don't fear command line. It is also ideal for scripts, automated backups triggered from cron, etc.

See the s3cmd homepage for more information.

282 questions
0
votes
1 answer

AWS EC2 S3 and thousands of directories with a few files in each s3cmd

I have tens of thousands of directories with a few files in each one on a non-AWS VPS (approx 1TB of data). I want to move them all to S3. I can either zip these in to chunks of 7GB, move (wget or whatever) to EC2 (8GB Ubuntu), unzip and s3cmd them…
Gordon
  • 393
  • 1
  • 3
  • 8
0
votes
1 answer

S3cmd not working in ubuntu

I have Installed s3cmd on my machine which is ubuntu 11.10 and when i am trying to download some data from s3 it gives me this error, I have also configure s3cmd with the access keys which i have (.s3cfg file is there in home…
RailsEnthusiast
  • 1,251
  • 2
  • 12
  • 18
0
votes
1 answer

Placing the contents from s3 to my file system?

I have been trying to push the files in s3 to my ec2 instance. When I do so : sudo s3fs -o allow_other -o default_acl="public-read" files /home/logs It doesn't give any error. But when I tried to look into the logs directory. I couldn't able to…
sriram
  • 8,562
  • 19
  • 63
  • 82
0
votes
1 answer

Set metadata recursively using s3cmd

I'm writing a shell script to sync a website tree of html files to s3. I'd like to set the metadata of any files without an extension to text/html. Is it possible to use s3cmd -m recursively?
Ben
  • 4,301
  • 6
  • 37
  • 61
0
votes
1 answer

Amazon S3: automatic deletion of certain files with s3cmd

I need a script for s3cmd that sends the deletion command for some files in my Amazon S3 bucket. I know there's this method built-in but it's not useuful. Let's see why. At the moment I have a script that backups my database every midnight and my…
MultiformeIngegno
  • 6,959
  • 15
  • 60
  • 119
0
votes
1 answer

mimic s3cmd list folder in php

what function/technique in aws phpsdk which equals with s3cmd ls s3:// i have the files uploaded into s3, which structure: folder_a/file_a.ext folder_a/file_aa.ext folder_b/file_b.ext folder_b/file_bb.ext I need to list first the folder without the…
herlambang
  • 185
  • 2
  • 9
-1
votes
1 answer

AWS: how to see the user1 created bucket by user2

Step 1: User1 created the test-bucket & uploaded couple of files Step 2: below policy is created and attached to the bucket { "Version":"2012-10-17", "Id":"policy example", "Statement": [ …
Chandra Duddukuri
  • 57
  • 1
  • 7
-1
votes
1 answer

AWS OVH (aws/aws-autoloader)

I can connect to my ovh storage: $s3Client = new S3Client(['profile' => 'default','endpoint' =>'http://storage.sbg.cloud.ovh.net', 'region' => 'SBG','version' => latest','credentials' => array('key' => $key,'secret' => $secret,)]); and list all my…
jjsteing
  • 67
  • 7
-1
votes
1 answer

Is there a way to backup all a bucket with s3cmd

I can upload, get, delete or list files in a bucket with s3cmd: s3cmd ls s3://y/ s3cmd put x.png s3://y/z # etc. Is there a way to get a backup of all the bucket (i.e: s3://y)?
rap-2-h
  • 30,204
  • 37
  • 167
  • 263
-1
votes
1 answer

openstack swift. region affinity account

Is it possible with openstack swift? I have cluster with 6 nodes in 3 datacenters(regions). In one datacenter I have huge disks. I want store my backups only in this region, but all other data should be available across regions.
Vango Rodriges
  • 1
  • 1
-2
votes
5 answers

"[ERROR] Sorry! The --v1 and --v2 flags have been removed."

Having this error and have not been able to resolve it after so many trials i have reinstalled the ionic cordova but still get this error when i want to use angular 2 (ionic start boxapp tabs --v2) [ERROR] Sorry! The --v1 and --v2 flags have been…
nath
  • 113
  • 2
  • 11
-2
votes
1 answer

s3cmd copy files preserving path

Is there a way to use copy files to an S3 bucket by preserving the file path? This is the example: 1. I produce a list of files that are different in bucket1 then in bucket2 using s3cmd sync --dry-run The list looks like…
Adi Chiru
  • 89
  • 1
  • 5
1 2 3
…
18
19