Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [amazon-s3]

This is for questions on Amazon's cloud storage service.

1120 questions
0
votes
1 answer

Best practice for storing personal information on AWS that we shouldn't be able to see

We store customer information that we shouldn't have access to, and don't want to inconvenience users by making them lose information if they forget their passwords, is there a good way to solve this problem, so that the devs who have access to our…
ze234we23
  • 13
  • 1
0
votes
0 answers

AWS Lambda's indirect S3 requests

I noticed AWS Lambda causes S3 tier 1 and 2 requests. Do these cost anything after 12 months free tier expires? Specifically: Create new AWS Lambda function in AWS console causes 1 tier 1 S3 request Amazon Simple Storage Service Requests-Tier1: $x…
fejyesynb
  • 111
  • 2
0
votes
1 answer

Restoring Terraform state from backend

My Terraform Git repository ended-up having some unreconciliable data error and I couldn't push a recent change. I exported my commit to a patch, recloned, applied the patch, and then realized I just blew-away all of my local state. I used AWS CLI…
Dustin Oprea
  • 560
  • 2
  • 8
  • 19
0
votes
0 answers

botocore.exceptions.ClientError: An error occurred (InvalidToken) when calling the ListObjectsV2 operation

I have an mlflow server that is hosted on aws, that uses s3 in the background for storage. I am trying to run a lambda-function that runs a python script which accesses the mlflow server, loads a pytorch model, makes predictions and finishes. The…
ptushev
  • 3
  • 3
0
votes
2 answers

How I can Log what and who can access and where my S3 bucket?

Recently I received an email in order to tell me that some IE connections has access to my bucket: eu-central-1|media.myapp | REST.GET.OBJECT|TLSv1|9|[Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; .NET CLR 2.0.50727;…
Dimitrios Desyllas
  • 563
  • 2
  • 11
  • 30
0
votes
0 answers

How do I setup a Google Cloud Storage bucket to be accessible via the Simple Storage Service (S3) standard?

I understand from Google documentation that it's possible for google cloud storage to be accessed via the Simple Storage Service, which is just what I need for a program that supports this. The program only explicitly refers to Amazon S3 storage but…
AdamJones
  • 113
  • 6
0
votes
1 answer

Storing 100 million files in the same "directory" under S3-compatible storage?

I have > 100 million image files (book covers) as a flat list of files under a single…
BenMorel
  • 4,507
  • 10
  • 57
  • 85
0
votes
1 answer

S3 / Cloudfront / Load balancer Architecture explanation needed

My architecture is like so: I have a static website xyz.com hosted on s3 and served with cloudfront. The website is accessing an api that seats behind a load balancer. I want to make sure that only requests from my website xyz.com are allowed…
April Henig
  • 1
0
votes
0 answers

How to serve both static and dynamic content via AWS cloudfront?

I have a site hosted on a digital ocean droplet which serves both static and dynamic content. The static content (e.g. /images, /js, /css, /fonts) is served from an s3 bucket with folders /images, /js, /css, /fonts via cloudfront which has a path…
adam78
  • 119
  • 1
  • 3
0
votes
0 answers

Whitelist an S3 Bucket in server firewall

I am looking for a way to whitelist an S3 Bucket on my client's server. In this S3 bucket there is a public website, thus, my idea is to find the ip address used for this S3 bucket. However, I have read from the documentation that it is using…
Vitomir
  • 103
  • 3
0
votes
1 answer

Getting 403 (Forbidden) when try to load an S3 file from AWS CloudFront behaviour

I have created an S3 bucket. All objects are publicly accessible. I can access the image file via S3 url: https://S3_BUCKET_NAME.s3.eu-west-1.amazonaws.com/xyz.jpg I can access the image file via CloudFront root url:…
tom
  • 1
0
votes
1 answer

Using S3 instead of MinIO for video management

I am relatively new to AWS so I wanted to reach out to the gurus in the community to get some advice on architecture, and I thought I would share my thoughts. I am building out cloud infrastructure for a Video Management Software for a Body Worn…
Jeremy Leys
  • 1
  • 1
0
votes
1 answer

Cloud File Storage: Does zipping files reduce data transmission speed / costs?

If I need to store, say, a 5gb file on a cloud file storage location (e.g., aws s3 bucket), will zipping the file reduce the cost / latency when people download it? Obviously zipping a file reduces the storage size, but my specific question is: Do…
Matt
  • 105
  • 2
0
votes
0 answers

Is storing data in S3 cheaper than paying for cross-az data transfer?

Imagine I have two EC2 instances A and B, in the same region/vpc, but in different AZs. I want to transfer 1TB from A to B. Now let's imagine two scenarios: I send the data from A to B directly. I upload the data from A to S3, then download the…
foo
  • 170
  • 8
0
votes
0 answers

Mimic user permissions on AWS EC2 instances using IAM roles

I'm setting up an AWS account with several users. Each of these users has policies attached that restrict their access to specific S3 buckets/objects and the EC2 instance types / Autoscaling Groups they can launch. Users can launch multiple…
Marcelo Villa-Piñeros
  • 101
  • 1
1 2 3
…
74 75