Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [amazon-s3]

This is for questions on Amazon's cloud storage service.

1120 questions
7
votes
1 answer

How to force s3fs mount on boot

I'm using s3fs 1.33 on Ubuntu 9.10 x86. I mount it manually with this command: sudo /usr/bin/s3fs mybucket /mnt/s3/mybucket -ouse_cache=/tmp How can I force the mount on boot? I guess that I have to write something to /etc/fstab. But what? And how…
Alexander Gladysh
  • 2,423
  • 8
  • 31
  • 49
7
votes
4 answers

What is the cheapest non-colocation way to serve about 10 static files at a rate of 100 megabits per second to the web?

I've looked at Amazon S3 and it costs roughly $4746 per month for 100 megabits/s (which translates into 31,640 Gigabytes of data transferred. That's at a rate of $0.15 per gig.) I haven't found a cheaper "cloud" option. I'm curious if there's any…
Mark172
  • 217
  • 1
  • 5
6
votes
1 answer

Does AWS cli do a data integrity check on sync with s3?

I've been looking into using AWS cli for data integrity checks to verify a backup has been transferred from a Linux file server correctly to AWS s3. Likewise, I would like to verify when restoring a file from backup to the Linux file server it also…
Edward_178118
  • 955
  • 4
  • 15
  • 33
6
votes
0 answers

How does S3FS (or any other S3 FUSE filsystem) compare to AWS FSx for Lustre + S3

I remember trying s3fs a year back, trying to use some S3 bucket as a FUSE filesystem. I remember it being quite laggy, especially when coupled with git operations on it (an oblivious system architect had a weird requirement like this). Fast forward…
dimisjim
  • 235
  • 2
  • 11
6
votes
3 answers

AWS S3 bucket size has exploded, but I can't figure out how

Something happened recently with one of our S3 buckets: I started looking for where all this extra stuff was coming from, but the metrics I gathered don't seem to match what is going on in CloudWatch (or our bill). The bucket has a handful of…
user31415629
  • 311
  • 2
  • 12
6
votes
3 answers

How to add lifecycle rule to an existing AWS S3 bucket with Terraform

I have an existing S3 bucket and I wish to add "folders" and lifecycle_rules to it. (I say "folders" because that is how they are represented at the client end, as they are accessed via a Storage Gateway.) I can create the folders, for example on to…
prowla
  • 71
  • 1
  • 4
6
votes
4 answers

MogileFS/GlusterFS/etc + Amazon EBS + Amazon EC2

I have a web application that serves binary files (images, etc). Our application runs on Amazon EC2. We were originally going to use Amazon S3 to store and serve these files, this is no longer an option. We need to transfer these files over HTTPS…
William
  • 367
  • 4
  • 11
6
votes
6 answers

Amazon EC2 & S3 costs - can they be tied to specific instances

I'd like to start using S3 and EC2 to host some of my company's simpler websites. I would like to be able to identify all of the costs associated with running each site (instance run-time costs + storage + data transfers) so that the costs can be…
monkeymagic
  • 98
  • 5
6
votes
1 answer

How to map subdomain in CloudFront to the same name in S3?

I have been searching for a way to do the following if someone can enlighten me would be greatly appreciated. e.g. would the following mappings be possible in a single CloudFront instance? feature-a.domain.com =>…
Van Nguyen
  • 588
  • 3
  • 6
  • 15
6
votes
2 answers

AWS elastic beanstalk: Errno 404 downloading file from S3 on deployment

I'm following the docs on fetching certificates from s3 when a new instance is deployed to elastic beanstalk. The instructions are fairly straightforward: create a config file under app-root/.ebextensions that reads: Resources: …
AlexanderF
  • 211
  • 1
  • 9
6
votes
1 answer

Difference Between Amazon S3 Select and Amazon Redshift Spectrum

Amazon Redshift Spectrum allows you to run queries directly against your data stored in Amazon S3. This also seems to be the purpose of the new Amazon S3 Select service. What are the main differences between these two services? Why should I choose…
Ryan Hilbert
  • 163
  • 1
  • 4
6
votes
1 answer

S3/Cloudfront CORS working on some files only

I'm really struggling to get Cloudfront and S3 to add Access-Control-Allow-Origin: * to the headers of video files stored on S3 (for inline video on iPhones - seems to be working everywhere else however inline video is only working on iPhones from…
beek
  • 225
  • 1
  • 10
6
votes
1 answer

AWS CloudFront Default Root Object and subdirectories

I'm hosting a Jekyll blog on S3 and CloudFront. Setting the default document on S3 works fine and all sub folders natively go to index.html. On my CloudFront distribution, I have set the Default Root Object to index.html, but sub directories do not…
Luke Griffith
  • 63
  • 1
  • 4
6
votes
3 answers

What is the benefit of VPC Endpoints on AWS?

I learned a long time ago that if you want an EC2 instance to be able to talk to AWS services like SQS, Kinesis and the like, the instance has to either have a public IP address or there needs to be something within the VPC doing NAT. When I first…
smitelli
  • 1,214
  • 1
  • 10
  • 16
6
votes
4 answers

Where are AMIs stored?

It seems like an very simple question, but yet I could not find the answer. When I make an instance on Amazon AWS and then make some changes and create an AMI where is that AMI stored? S3? Will making extra AMIs be added to the amount payed each…
user277526
1 2 3
…
74 75