Stack Overflow
Stack Overflow

Questions tagged [amazon-s3]

Amazon S3 (simple storage service) is an online object storage service from Amazon Web Services. QUESTIONS MUST BE ABOUT PROGRAMMING. Questions about general S3 support, functionality, configuration, etc. are OFF-TOPIC.

Amazon S3 (Simple Storage Service) is an online strongly consistent storage web service offered by Amazon Web Services. Amazon S3 provides storage through a simple web services interface. It gives any developer access to the same highly scalable, reliable, secure, fast, inexpensive infrastructure that Amazon uses to run its own global network of web sites.

References

Tutorials

49879 questions
12
votes
2 answers

Django StaticFiles and Amazon S3: How to detect modified files?

I'm using django staticfiles + django-storages and Amazon S3 to host my data. All is working well except that every time I run manage.py collectstatic the command uploads all files to the server. It looks like the management command compares…
Yuji 'Tomita' Tomita
  • 115,817
  • 29
  • 282
  • 245
12
votes
3 answers

How to track upload progress to S3 using aws-sdk V3 for browser (javascript)

I can find a lot of resources online on how to track upload progress to S3 using aws-sdk V2, listening to the event like: .on('httpUploadProgress', event => {} But since I updated the aws-sdk to V3, there are no listeners anymore. I believe I have…
yaiks
  • 576
  • 3
  • 13
12
votes
4 answers

How to overcome Spark "No Space left on the device" error in AWS Glue Job

I had used the AWS Glue Job with the PySpark to read the data from the s3 parquet files which is more than 10 TB, but the Job was failing during the execution of the Spark SQL Query with the error java.io.IOException: No space left on the device On…
Vigneshwaran
  • 782
  • 2
  • 7
  • 22
12
votes
1 answer

How to delete a s3 version from a bucket using boto and python

When I try to delete a bucket using the lines: conn = boto.connect_s3(AWS_ACCESS_KEY_ID, AWS_SECRET_ACCESS_KEY) print conn.delete_Bucket('BucketNameHere').message It tells me the bucket I tried to delete is not empty. The bucket has no keys in it.…
ChickenFur
  • 2,360
  • 3
  • 20
  • 26
12
votes
6 answers

I got de error when I tried install composer league/flysystem-aws-s3-v3

I got de error when I tried install composer league/flysystem-aws-s3-v3 My line: composer require league/flysystem-aws-s3-v3 I using Laravel 8 and php 7.3 I also tested removing composer.lock Someone already fixed it? Your requirements could…
Petronio Amaral
  • 171
  • 1
  • 1
  • 7
12
votes
2 answers

Trying to display an image stored in aws S3 to React application

I have a private aws s3 container full of images I want to use on my SPA. On the backend I am using express, to try to get access to these images. This is my code on node, where I get the object from s3 container, but I don't know how to display the…
Jonathan G.
  • 243
  • 1
  • 2
  • 12
12
votes
2 answers

How to deploy (sync) Rails 3.1 precompiled assets with Amazon s3

How can I deploy my precompiled assets of Rails 3.1 pipeline to s3? I need a task to automate this syncing work with my assets bucket. EDIT: This gem is exactly which I need: https://github.com/rumblelabs/asset_sync.
Edison Machado
  • 1,410
  • 19
  • 29
12
votes
2 answers

How to check if bucket already exists in AWS S3

How can I check if the bucket already exists in my Aws S3 account using Java SDK? Using below code AmazonS3ClientBuilder.defaultClient().doesBucketExistV2(bucketName); Checks global existence of bucket and returns true if a bucket with this…
CodeTalker
  • 1,683
  • 2
  • 21
  • 31
12
votes
1 answer

aws s3 sdk returns "You have attempted to create more buckets than allowed"

I'm using aws s3 SDK in my code. In my tests I'm trying to create/drop buckets for the test. My sdk version is 1.11.800 : 1.11.800 1.11.800 The…
JeyJ
  • 3,582
  • 4
  • 35
  • 83
12
votes
3 answers

How do I upload a file to a pre-signed URL in AWS using Node.js and Axios?

I have next scenario: Generate a signed URL for file upload by AWS-SDK Try to upload a local file using Axios (or request) npm package But every time I have an error: Status: 403 statusText: Forbidden
misterioss
  • 431
  • 2
  • 4
  • 13
12
votes
2 answers

Upload file from memory to S3

I have downloaded a csv file from S3 into memory and edited the file using Boto3 and Python. How can I can reupload this file to S3 without ever storing it locally?
Ciaran
  • 451
  • 1
  • 4
  • 14
12
votes
2 answers

Read Excel from S3 - AttributeError: 'StreamingBody' object has no attribute 'seek'

I have a python script which reads an excel file from S3 but getting an error when it's triggered in AWS Batch. The code works fine on another Ubuntu box. AttributeError: 'StreamingBody' object has no attribute 'seek' Section of my code to read the…
mtryingtocode
  • 939
  • 3
  • 13
  • 26
12
votes
2 answers

Keep query strings with AWS Amplify Hosting - React

I currently have a react app using react-router-dom that works locally but not when deployed using AWS Amplify. The problem is that when I route to a URL and use query strings, the browser gets a redirect and drops the query strings. For example…
rocketlobster
  • 690
  • 7
  • 18
12
votes
2 answers

Uploading a Dataframe to AWS S3 Bucket from SageMaker

I am new to AWS environment and trying to solve how the data flow works. After successfully uploading CSV files from S3 to SageMaker notebook instance, I am stuck on doing the reverse. I have a dataframe and want to upload that to S3 Bucket as CSV…
realkes
  • 833
  • 1
  • 12
  • 20
12
votes
6 answers

Call S3 pre-signed URL with postman

I am attempting to use a pre-signed URL to upload as described in the docs (https://docs.aws.amazon.com/AmazonS3/latest/dev/PresignedUrlUploadObject.html) I can retrieve the pre-signed URL but when I attempt to do a PUT in Postman, I receive the…
user2149161
  • 123
  • 1
  • 2
  • 6
1 2 3
…
99
100