Stack Overflow
Stack Overflow

Questions tagged [amazon-s3]

Amazon S3 (simple storage service) is an online object storage service from Amazon Web Services. QUESTIONS MUST BE ABOUT PROGRAMMING. Questions about general S3 support, functionality, configuration, etc. are OFF-TOPIC.

Amazon S3 (Simple Storage Service) is an online strongly consistent storage web service offered by Amazon Web Services. Amazon S3 provides storage through a simple web services interface. It gives any developer access to the same highly scalable, reliable, secure, fast, inexpensive infrastructure that Amazon uses to run its own global network of web sites.

References

Tutorials

49879 questions
185
votes
3 answers

Technically what is the difference between s3n, s3a and s3?

I'm aware of the existence of https://wiki.apache.org/hadoop/AmazonS3 and the following words: S3 Native FileSystem (URI scheme: s3n) A native filesystem for reading and writing regular files on S3. The advantage of this filesystem is that you can…
Hello lad
  • 17,344
  • 46
  • 127
  • 200
182
votes
4 answers

Amazon S3 - HTTPS/SSL - Is it possible?

I saw a few other questions regarding this without any real answers or information (or so it appeared). I have an image here: http://furniture.retailcatalog.us/products/2061/6262u9665.jpg Which is redirecting…
Kerry Jones
  • 21,806
  • 12
  • 62
  • 89
176
votes
8 answers

Nodejs AWS SDK S3 Generate Presigned URL

I am using the NodeJS AWS SDK to generate a presigned S3 URL. The docs give an example of generating a presigned URL. Here is my exact code (with sensitive info omitted): const AWS = require('aws-sdk') const s3 = new…
Dustin
  • 2,091
  • 3
  • 15
  • 13
175
votes
20 answers

AWS S3 CLI - Could not connect to the endpoint URL

$ aws s3 ls Could not connect to the endpoint URL: "https://s3.us-east-1a.amazonaws.com/" What could be the problem?
Prabhat
  • 4,066
  • 4
  • 34
  • 41
175
votes
20 answers

Retrieving subfolders names in S3 bucket from boto3

Using boto3, I can access my AWS S3 bucket: s3 = boto3.resource('s3') bucket = s3.Bucket('my-bucket-name') Now, the bucket contains folder first-level, which itself contains several sub-folders named with a timestamp, for instance 1456753904534. I…
mar tin
  • 9,266
  • 23
  • 72
  • 97
175
votes
19 answers

Amazon S3 exception: "The specified key does not exist"

I am using the AmazonS3Client in an Android app using a getObject request to download an image from my Amazon S3 bucket. Currently, I am getting this exception: com.amazonaws.services.s3.model.AmazonS3Exception: The specified key does not exist. …
user4592690
  • 1,871
  • 2
  • 10
  • 5
175
votes
15 answers

AWS CloudFront: Font from origin has been blocked from loading by Cross-Origin Resource Sharing policy

I'm receiving the following error on a couple of Chrome browsers but not all. Not sure entirely what the issue is at this point. Font from origin https://ABCDEFG.cloudfront.net has been blocked from loading by Cross-Origin Resource Sharing policy:…
Dallas Clark
  • 4,064
  • 3
  • 30
  • 36
173
votes
25 answers

The authorization mechanism you have provided is not supported. Please use AWS4-HMAC-SHA256

I get an error AWS::S3::Errors::InvalidRequest The authorization mechanism you have provided is not supported. Please use AWS4-HMAC-SHA256. when I try upload file to S3 bucket in new Frankfurt region. All works properly with US Standard…
Alexey
  • 2,326
  • 5
  • 17
  • 27
171
votes
18 answers

How to upgrade AWS CLI to the latest version?

I recently noticed that I am running an old version of AWS CLI that is lacking some functionality I need: $aws --version aws-cli/1.2.9 Python/3.4.3 Linux/3.13.0-85-generic How can I upgrade to the latest version of the AWS CLI…
Borealis
  • 8,044
  • 17
  • 64
  • 112
169
votes
11 answers

Set cache-control for entire S3 bucket automatically (using bucket policies?)

I need to set cache-control headers for an entire s3 bucket, both existing and future files and was hoping to do it in a bucket policy. I know I can edit the existing ones and I know how to specify them on put if I upload them myself but…
thattommyhall
  • 1,809
  • 2
  • 12
  • 7
166
votes
16 answers

Amazon S3 console: download multiple files at once

When I log to my S3 console I am unable to download multiple selected files (the WebUI allows downloads only when one file is selected): https://console.aws.amazon.com/s3 Is this something that can be changed in the user policy or is it a limitation…
mm24
  • 9,280
  • 12
  • 75
  • 170
163
votes
8 answers

FTP/SFTP access to an Amazon S3 Bucket

Is there a way to connect to an Amazon S3 bucket with FTP or SFTP rather than the built-in Amazon file transfer interface in the AWS console? Seems odd that this isn't a readily available option.
zgall1
  • 2,865
  • 5
  • 23
  • 39
163
votes
13 answers

Amazon S3 boto - how to create a folder?

How can I create a folder under a bucket using boto library for Amazon s3? I followed the manual, and created the keys with permission, metadata etc, but no where in the boto's documentation it describes how to create folders under a bucket, or…
vito huang
  • 4,228
  • 7
  • 26
  • 24
162
votes
22 answers

how to delete files from amazon s3 bucket?

I need to write code in python that will delete the required file from an Amazon s3 bucket. I am able to connect to the Amazon s3 bucket, and also to save files, but how can I delete a file?
Suhail
  • 2,847
  • 2
  • 19
  • 16
161
votes
14 answers

How to delete files recursively from an S3 bucket

I have the following folder structure in S3. Is there a way to recursively remove all files under a certain folder (say foo/bar1 or foo or foo/bar2/1 ..) foo/bar1/1/.. foo/bar1/2/.. foo/bar1/3/.. foo/bar2/1/.. foo/bar2/2/.. foo/bar2/3/..
priya
  • 24,861
  • 26
  • 62
  • 81
1 2
3
…
99 100