Questions tagged [amazon-s3]

This is for questions on Amazon's cloud storage service.

1120 questions
8
votes
3 answers

Is mounting S3 buckets directly into EC2 instances safe?

as the title of my question says, I would like to know whether this is a good practice or not, I know I can mount it in an EC2 instance but I was wondering if, as I will be adding more instances to scale my application, this might cause some…
Enrico Tuttobene
  • 227
  • 2
  • 5
  • 11
8
votes
5 answers

Is S3 cheaper than a EC2 DIY solution (for small files)

Is it really cheaper to host images and scripts via S3 than with an EC2 instance running nginx/varnish/etc. ? It seems to me (but i'm just getting started with AWS) that the request costs will be the major factor if you don't use sprites or other…
Jann
  • 183
  • 1
  • 2
  • 8
8
votes
3 answers

What's the best practice for taking MySQL dump, encrypting it and then pushing to s3?

This current project requires that the DB be dumped, encrypted and pushed to s3. I'm wondering what might be some "best practices" for such a task. As of now I'm using a pretty straight ahead method but would like to have some better ideas where…
J. LaRosee
  • 183
  • 1
  • 5
7
votes
2 answers

Can not unmount an S3 directory mounted with s3fs-fuse

I have an s3fs-fuse "device" mounted at /mnt/s3. I want to unmount it so that I can remount it with the mp_umask flag so that chroot will work properly. The command should be: fusermount -u /mnt/s3 Unfortunately the result is: fusermount: failed to…
RubyRedGrapefruit
  • 501
  • 3
  • 6
  • 17
7
votes
1 answer

Why is only index.html available from an S3 bucket served by CloudFront, and nothing else?

I am trying to expose a static site hosted in S3 though CloudFront. The S3 bucket (testyop1) is set to host static websites (not in public mode) and its bucket policy is { "Version": "2008-10-17", "Id": "PolicyForCloudFrontPrivateContent", …
WoJ
  • 3,607
  • 9
  • 49
  • 79
7
votes
1 answer

Access Denied when syncing between s3 buckets on different AWS accounts

I'm trying to setup sync between two buckets on different AWS accounts. I got cp working with: @ubuntu:~$ s3cmd cp -v s3://src/dir/ s3://dest/folder --recursive I am the user who owns /src/dir and I've added: { "Version": "2012-10-17", "Id":…
OrigamiEye
  • 182
  • 1
  • 1
  • 8
7
votes
3 answers

Backup AWS EFS to S3

I've been desperately trying to find a way to backup my AWS EFS file system to S3, but cannot seem to find one. There's several EC2 instances running all having access to the mentioned EFS. In order to reduce traffic, I already tried launching a…
wahtye
  • 71
  • 1
  • 1
  • 2
7
votes
1 answer

Url rewriting in Amazon S3

I have a webapp hosted in Amazon S3, the webapp is build with jQuery Mobile and I use changePage lo navigate between pages, I'm not using the hash operator(#) when I change the page. I'm having problems when the user copy the url and paste it in a…
Fernando P. G.
  • 141
  • 1
  • 1
  • 7
7
votes
3 answers

How to store a Cloudfront custom error page in S3?

I have a Cloudfront plugged on an AWS load balancer. I saw in the AWS documentation that I can customize Cloudfront custom error pages. I tried to store these error pages in S3 as it is recommended in the AWS doc but it doesn't work. The…
jsebfranck
  • 213
  • 1
  • 2
  • 7
7
votes
3 answers

Strict-Transport-Security on CloudFront with S3 origin?

My company's site has a static homepage for speed and cost reasons. We use S3 as the origin for CloudFront. Now, we would like to declare Strict-Transport-Security for the entire domain, but S3 seems to not send any headers we specify (beyond ones…
7
votes
2 answers

Does Amazon CloudFront charge for storage?

I've been reviewing the features and prices of Amazon S3 and Amazon CloudFront as well as similar services offered by other providers. One thing I can't understand is why Amazon CloudFront pricing doesn't seem to have a cost for storage as the other…
user101340
7
votes
2 answers

Is there a way to retrieve all contents from a versioned Amazon S3 bucket as of a particular datetime

Is it possible via the AWS CLI or via some third-party tool to easily download all contents of a versioned bucket as it was on a particular datetime? I.E. I would like to retrieve the version of each object in the bucket which would have been…
Nada_Surf
  • 193
  • 2
  • 7
7
votes
1 answer

Using Amazon s3 and Cloudfront what is the best way to set expires headers and cache expiration

We have a huge bucket of photos on s3. We add and remove from this daily but it currently has millions of photos that we don't want to rewrite or update if possible. We have not set any expires headers on these existing photos. I just Spun up…
Tom DeMille
  • 239
  • 3
  • 8
7
votes
2 answers

rsnapshot to Amazon S3?

I'm looking at rsnapshot and S3 to backup my server. But since rsnapshot can't directly upload to S3, and I'm not sure if S3 preserves file permissions, I'm thinking of archiving the backup folders created by rsnapshot and uploading them to S3. Is…
john2x
  • 173
  • 1
  • 6
7
votes
7 answers

s3cmd fails too many times

It used to be my favorite backup transport agent but now I frequently get this result from s3cmd on the very same Ubuntu server/network: root@server:/home/backups# s3cmd put bkup.tgz s3://mybucket/ bkup.tgz -> s3://mybucket/bkup.tgz [1 of 1] …
alfish
  • 3,127
  • 15
  • 47
  • 71