This is for questions on Amazon's cloud storage service.
Questions tagged [amazon-s3]
1120 questions
0
votes
1 answer
Trying to understand S3 Lifecycle rule
I am working on an e-commerce website.
I store product photos in an s3 bucket. Once the product is deleted, I also delete the photos from s3 bucket.
I have S3 bucket versioning enabled. I am not entirely sure how does versioning wortk?
Here are my…
Hooman Bahreini
- 518
- 6
- 17
0
votes
1 answer
How to download millions of s3 files and compress them on the fly?
I have an S3 bucket with millions of files, and I want to download all of them.
Since I don't have enough storage, I would like to download them, compress them on the fly and only then save them. How do I do this?
To illustrate what I mean:
aws s3…
jorge
- 1
- 1
- 1
0
votes
1 answer
Bandwidth consumption of Amazon S3 bucket mounted with S3fs on a VPS
I have :
VPS server on Vultr with web server and Wordpress installed.
Uploads folder is mounted on Amazon S3 bucket using s3fs.
If a user downloads a 1GB file from my website will the traffic be served to him from Amazon S3 directly or it will be…
Imad Sid
- 1
- 1
0
votes
1 answer
S3 Logs event Issue
Is there a way to see what actions the 'g2' IAM user is performing in S3, and which IP(s) they are running from? I have already enabled the logging of S3 actions.
One point I’m still not able to figure out is that when I’m trying to find logs in…
samtech 2021
- 81
- 7
0
votes
1 answer
Sending push notification to s3 origin website from lambda
I want to send a websockets notification from lambda function to clients, on a website hosted via s3 origin with cloudfront.
Could someone help me with this, please? Thanks.
NaNa
- 3
- 1
0
votes
1 answer
aws cloudfront custom ssl pricing for subdomain and www
I have created two s3 origin website linked with cloudfront and used acm certificate.
But I recently found out pricing are different between https://admin.example.com and https://www.example.com.
www.example.com is charged for 20$ per day but admin…
NaNa
- 3
- 1
0
votes
0 answers
CloudFront delivery is slow in particular location
In our scenario, I found that our CloudFront delivery particularly in the Japan area is very slow for a few days. which lead our site to become slow in the time of loading the media contents .our s3 origin is in the Northern Virginia region. what…
samtech 2021
- 81
- 7
0
votes
1 answer
DNS - GoDaddy for mail and AWS for rest
I have a GoDaddy hosting account but for some of my websites I would like to host them in AWS S3. My question is how to set DNS entries in Route 53 so that I keep web traffic served from S3 but I point email traffic to GoDaddy?
Thank you
cebucul
- 1
0
votes
1 answer
Setting up an architecture for analyses flows of time stream data from multiple sources
What would be the best practice in terms of AWS for the following:
Many IOT medical devices gather data at around 256kBps
The data is a time series data (a matrix of [Channels X Samples], there can be millions of samples and dozens of…
sstbrg
- 1
0
votes
2 answers
Unable to mount a folder in Ubuntu to as AWS S3 Bucket
I am attempting to mount a folder on a fresh AWS EC2 instance running Ubuntu 18.04, to AWS S3.
I've been following instructions I found at https://cloud.netapp.com/blog/amazon-s3-as-a-file-system and…
Alex Little
- 101
0
votes
2 answers
Terraform: "S3:path_to_terraform.tfstate": x509: cannot validate certificate for because it doesn't contain any IP SANs
I'm using s3 to save my state. since this is a custom S3 (and not AWS) I configured it as shown below (using IP + Port).
when running terraform init I received this error:
Successfully configured the backend "s3"! Terraform will automatically
use…
winter
- 103
- 4
0
votes
0 answers
AWS S3 bucket policy does not define Put, yet it is allowed
I have a public static website which images can be uploaded to. For this I enabled static website hosting and set Block public access to OFF. I then added this policy
{
"Version": "2012-10-17",
"Id": "Policy1632669906301",
"Statement":…
pbuzz007
- 113
- 6
0
votes
0 answers
AWS S3 bucket policy for get and upload
I have two buckets each with their own goals. So far I cannot understand the complicated configuration of bucket settings. It seems there are three things to configure
Block public access
Bucket policy
ACL
I know that if I turn off (1), that…
pbuzz007
- 113
- 6
0
votes
2 answers
AWS S3 Static Website vs CloudFront OIA
It seems there are kind of two ways to host a static website on S3/CloudFront.
Create S3 bucket with full public access and Static Website set to Enabled + CloudFront config
Create S3 bucket with no public access and Static Website set to Disabled…
pbuzz007
- 113
- 6
0
votes
1 answer
API gateway cache every hour
My API is set up as follows:
API Gateway > Lambda function > S3
Every hour the S3 content is updated at the same time. How do I configure API gateway to cache the endpoint's responses but serve new content every hour?
For example
a get request at…
nipy
- 107
- 3