Stack Overflow
Stack Overflow

Questions tagged [amazon-s3]

Amazon S3 (simple storage service) is an online object storage service from Amazon Web Services. QUESTIONS MUST BE ABOUT PROGRAMMING. Questions about general S3 support, functionality, configuration, etc. are OFF-TOPIC.

Amazon S3 (Simple Storage Service) is an online strongly consistent storage web service offered by Amazon Web Services. Amazon S3 provides storage through a simple web services interface. It gives any developer access to the same highly scalable, reliable, secure, fast, inexpensive infrastructure that Amazon uses to run its own global network of web sites.

References

Tutorials

49879 questions
13
votes
3 answers

Amazon S3 on Heroku with PHP

I would like to enable the use of my Amazon S3 bucket for my Heroku application. Before Heroku, I was using s3fs to mount the directory directly. Now that this is not possible on Heroku, is there any other way to "link" them together, possibly by…
carmelo arena
  • 551
  • 1
  • 4
  • 15
13
votes
2 answers

Prevent hotlinking of Amazon S3 files?

I'd like to allow anyone to play a video located in my s3 on my site as the src on a
tim peterson
  • 23,653
  • 59
  • 177
  • 299
13
votes
3 answers

Classic ASP amazon s3 rest authorisation

I am confused on what I am doing wrong here... <% Const AWS_BUCKETNAME = "uk-bucketname" Const AWS_ACCESSKEY = "GOES HERE" Const…
Chris Dowdeswell
  • 858
  • 2
  • 11
  • 25
13
votes
2 answers

Parallel batch file download from Amazon S3 using AWS S3 SDK for .NET

Problem: I would like to download 100 files in parallel from AWS S3 using their .NET SDK. The downloaded content should be stored in 100 memory streams (the files are small enough, and I can take it from there). I am geting confused between Task,…
DenNukem
  • 8,014
  • 3
  • 40
  • 45
13
votes
2 answers

django-storages with Amazon S3 - prevent overwriting

I noticed that django-storages (or perhaps it's Django's storage API itself) overwrites files with the same name. This is a problem for me as my site allows user uploads, so I need to ensure that files are never overwritten. Ideally I'd like to be…
Wayne Koorts
  • 10,861
  • 13
  • 46
  • 72
12
votes
5 answers

Delete folder in Amazon S3 using PHP

I just started trying out Amazon S3 for hosting my website's images. I'm using the official Amazon AWS PHP SDK library. Problem: How can I delete all files located in a S3 'folder'? For example if I have a file named images/2012/photo.jpg, I want…
Nyxynyx
  • 61,411
  • 155
  • 482
  • 830
12
votes
4 answers

How to set amazon S3 bucket policy to private to everyone except admin?

I've got a bucket where i've accidently uploaded thousands of files with ACL to :public_read I would like all files to be unavailable except with a generated access URL. I tried to create a bucket policy with deny all to everyone, and allow all to…
vdaubry
  • 11,369
  • 7
  • 54
  • 76
12
votes
3 answers

Check if a key with a certain prefix exists in Amazon S3 bucket

How would I check if there's a key that starts with a particular prefix, similar to "folders"?
Ian Warburton
  • 15,170
  • 23
  • 107
  • 189
12
votes
1 answer

Upload direct to S3 or via EC2?

I would like to build a web service for an iPhone app. As for file uploads, I'm wondering what the standard procedure and most cost-effective solution is. As far as I can see, there are two possibilities: Client > S3: I upload a file from the…
n.evermind
  • 11,944
  • 19
  • 78
  • 122
12
votes
2 answers

Adding Additional Headers to Carrierwave for Amazon s3 Encryption

In short In short I want to know if I can send additional headers through a carrierwave and fog connection to Amazon s3? In depth I recently found that amazon supports Client and Server side encryption of files. more info »…
JonathanSimmons
  • 1,528
  • 1
  • 16
  • 28
12
votes
6 answers

Granting read access to the Authenticated Users group for a file

How do I grant read access to the Authenticated Users group for a file? I'm using s3cmd and want to do it while uploading but I'm just focusing directly on changing the acl. What should I put in for…
user983223
  • 1,146
  • 2
  • 16
  • 32
12
votes
1 answer

AWS s3 file downloads are not working in Chrome (Works fine with IE, Mozilla, Safari)

I am using s3 to store my pdf files. But when i tries to download the files from s3 using chrome browser it doesn't do anything. It just refresh the page, no error, nothing ... But from other browsers i can download that file. When i checked in the…
Vijay Kumbhar
  • 896
  • 1
  • 13
  • 31
12
votes
6 answers

zcat on amazon s3

Is it possible to cat a gzip file stored on amazon s3? Maybe using some streamming client? We are looking for a operation similar to zcat s3://bucket_name/your_file | grep "log_id"
raimonbosch
  • 418
  • 1
  • 5
  • 14
12
votes
0 answers

Glue Dynamic Frame is way slower than regular Spark

In the image below we have the same glue job run with three different configurations in terms of how we write to S3: We used a dynamic frame to write to S3 We used a pure spark frame to write to S3 Same as 1 but reducing the number of worker nodes…
justHelloWorld
  • 6,478
  • 8
  • 58
  • 138
12
votes
2 answers

How to render dynamic Next.js paths on static S3/CloudFront website hosting?

Summary I'm trying to setup Next.js with static website hosting on S3 and CloudFront. For the most part it works but I'm having trouble with dynamic routes. My directory structure looks like this. pages/ index.js about.js [id].js Currently my…
alexedwardjones
  • 561
  • 1
  • 5
  • 18
1 2 3
…
99
100