Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [amazon-s3]

This is for questions on Amazon's cloud storage service.

1120 questions
9
votes
3 answers

What's the easiest way to back up EC2 instances automatically?

I'm worried I might log in one day and my fully configured instance has been removed. I would like to be able to back it up daily to S3 but frustratingly this is not a simple setting in the console. Is there a simple managed solution that can take…
chrism2671
  • 2,579
  • 9
  • 34
  • 45
9
votes
3 answers

CNAME with S3 buckets

I have a Web and I wanted to move its images to AWS S3. Say it's called mypage.com and I can access to an image like this: https://mypage.com/pics/one.jpg I created a bucket called static.mypage.com to put there all the images, so now I can access…
Ommadawn
  • 235
  • 2
  • 8
8
votes
1 answer

S3 logs do not appear in targeted bucket

I have two buckets, one named A and another named logs. I went to the permissions page for A and enabled service logging, and set the target to logs bucket. According to the AWS documentation, this should enable logging. Amazon S3 uses a special…
jeebface
  • 265
  • 1
  • 3
  • 8
8
votes
2 answers

Proxy for a local mirror of S3 directories

We have an office that has increasing demand for accessing large files from our own Amazon S3 directories. Being able to access them quickly is important for our business, so we believe it is time to start keeping copies of the files onsite. This is…
Eric Simonton
  • 181
  • 1
  • 4
8
votes
3 answers

Streaming PostgreSQL pg_dump to S3

Is it possible or advisable to stream/pipe pg_dump output to S3? We are dumping large datasets to our instance and the database size is big. So trying to optimize for local disk space (avoid temp space for dump) and create the backup straight on…
kapso
  • 2,083
  • 4
  • 15
  • 7
8
votes
2 answers

How to backup a s3 bucket to the glacier?

I'm having some difficulty setting up my S3 to make an automatic backup to Glacier. That is, I want a copy of my s3 on the glacier every day. How to do this?
Paloma Macetko
  • 81
  • 1
  • 2
8
votes
1 answer

Copy s3 contents of bucket, including all versions

I have a few S3 buckets that I want to hand access over to another organisation, as am handing over an existing hosting client to them. After looking through the docs, if I no longer want to be responsible for the bucket, it seems the simplest…
Chris Adams
  • 709
  • 3
  • 11
  • 18
8
votes
2 answers

Does AWS S3 lifecycle rule delete folders?

I have an S3 bucket with several folders and each folder contains several files. Because the number of files keep growing, I'm thinking to create a S3 lifecycle rule to delete files older than 14 days. My concern is that this rule might also delete…
GreenTeaTech
  • 231
  • 1
  • 3
  • 7
8
votes
2 answers

Cant connect to S3 with nginx

I'm trying to serve static and media files from the amazon S3 bucket but Nginx can't connect to it Here is the error I get AccessDenied AWS authentication requires a valid Date or x-amz-date…
bboumend
  • 181
  • 1
  • 3
8
votes
5 answers

How can I set up an SFTP server backed by S3 (or similar)

I need to set up an SFTP server that, essentially, has very large capacity. I need to give one of our partners SFTP login details to a server where they will upload millions of files, totalling a few hundred Terabytes. I will then be selective and…
Daniel Magliola
  • 1,432
  • 9
  • 20
  • 33
8
votes
2 answers

CloudFront S3 Access denied

I have one account with privilege to manage S3 (S3_User), and another one to manage Cloud Front (Cloud_Front_User). Now, I've created a bucket "bucketname" with S3_User and a distribution with Cloud_Front_User with origin my S3 Bucket. When I tried…
sparkle
  • 175
  • 1
  • 1
  • 8
8
votes
2 answers

I'm trying to use "aws s3 sync" on my EC2 instance. Is the '--exclude' option broken?

I'm trying to backup my EC2 instance to S3 using Amazon's official tools that come preinstalled on the EC2 instance. I'm having difficulty getting the sync command to exclude directories from the sync. The documentation makes it sound like it's easy…
user158845
  • 91
  • 1
  • 1
  • 4
8
votes
1 answer

Amazon S3 appears to be blocking cloudflare IP addresses. How do I fix it?

I have static content that is being served by Cloudflare. Cloudflare points to Amazon S3 to pick up the static content and serves it via a CNAME (cdn.mydomain.com). The bucket is setup properly and everything was working fine for months until…
JStark
  • 181
  • 3
8
votes
3 answers

Storing and serving files securely for multiple clients

We are working on a web app, where (among other features) our users can upload their files. However we can't store these files on our VPS because storage space is limited, so we decided to go with S3. The main problem is that we must make sure users…
Tamás Pap
  • 183
  • 1
  • 6
8
votes
3 answers

Duplicity not writing to a pre-existing S3 bucket

I'm trying to backup a directory to a pre-existing Amazon S3 bucket using the following command: duplicity --no-encryption system/ s3+http://MY_BUCKET_NAME/backup However, I'm getting the following error consistently: S3CreateError: S3CreateError:…
Saurabh Nanda
  • 489
  • 1
  • 8
  • 20
1 2 3
…
74 75