Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [amazon-s3]

This is for questions on Amazon's cloud storage service.

1120 questions
0
votes
0 answers

AWS S3 IllegalLocationConstraintException Wordpress Updraft Backup

I have successfully connected with S3 and updraft backup but I got a problem. S3 settings test result: Failure: Region: ap-southeast-3: We successfully accessed the bucket, but the attempt to create a file in it failed. Please check your access…
Yohanim
  • 157
  • 1
  • 3
  • 10
0
votes
0 answers

CloudFront Access Logs Issue

I was tried querying our CloudFront logs using Athena for an error i'm getting but haven't received any results. The query i'm trying using is: SELECT * FROM cloudfront_logs WHERE request_id = >…
samtech 2021
  • 81
  • 7
0
votes
0 answers

S3 Fatal error: Failed to connect to proxy URL: "Proxy url"

Good Afternoon, I have been trying to remove some files from S3, last week I did not have any issues accessing my s3 bucket however now any s3 cmd fails with the error message above, I cant even run aws s3 ls now with out seeing that error. Nothing…
Trizzle
  • 9
  • 1
0
votes
0 answers

How suitable is a S3 backend for rsync operations?

I run a large server providing open source software (https://ftp.halifax.rwth-aachen.de), currently serving more than 30 TByte of data with Multi-Gigabit throughput. Data is synchronized and kept up-to-date using rsync, i.e. synchronizing the data…
C-Otto
  • 334
  • 5
  • 18
0
votes
0 answers

Serve cephFS files over HTTP (or S3?)

I have a CEPH+LXD cluster configuration. And I would like to serve the files in the container over HTTP (S3,whatever doesn't matter). Is there a way to do this using the rgw service? Like can I point it to serve the cephFS directories and stuff? In…
mohamed emad
  • 11
  • 3
0
votes
1 answer

Rails 6 - Understanding AWS Pricing for CDN video on demand application

I am working on an Rails 6 application, already on production which is heavily dependent on AWS Services like S3, Lambda, Cloudtrail, SNS and CDN to serve a video-on-demand app, where users can upload large videos and view and share it with…
Milind
  • 101
  • 2
0
votes
1 answer

Backup from S3 to S3

I'd like to backup multiple S3 buckets into another S3 buckets. It seems like most backup tools only support S3 as a destination, but not as a source e.g. restic. The backup should support pruning, deduplication, not having to download the entire…
TomTom
  • 129
  • 1
  • 1
  • 4
0
votes
0 answers

Create Windows 10 AMI for EC2 AWS

I have case to create AMI based on windows 10 OS, the AMI file will be used on AWS ec2 to run some our 3rd party programs for client. I have tried to follow several tutorial and guidelines from google and youtube. But the problem still persists when…
Ahmad_Green
  • 1
0
votes
0 answers

How to read files from a directory having name "/" in S3 bucket?

Code: val df = spark.read.csv("s3a://sample_bucket//csvFiles/file.csv"); Error: 22/06/23 20:02:57 WARN impl.MetricsConfig: Cannot locate configuration: tried…
Slow_learner
  • 1
  • 1
0
votes
1 answer

nginx proxy_pass fallback location

I'm using nginx as a reverse proxy for my web application with proxy_pass for the api. This is my current config, where I've nginx directive location /data/ where images are being displayed from the /data directory of my docker container. location…
Shyam
  • 1
  • 1
0
votes
0 answers

Breakdown of AWS S3 DataTransfer-Out-Bytes costs per object

I have an app where various customers upload files to a single S3 bucket in my AWS account. Over time the costs of DataTransfer-Out-Bytes have grown and I want to see if there's some way to understand which objects/URLs are getting the most traffic…
Richard
  • 1
0
votes
0 answers

Unable to access few objects in S3

Why some objects are accessible in S3 bucket and some are not. Following are the below errors we faced. Though I checked the access and it seems to be fine. Exception while connecting S3: An error occurred (403) when calling the HeadBucket…
Prats
  • 1
  • 1
0
votes
1 answer

How do I extract a list of all folders of my AWS S3 storage bucket or directories?

Does Amazon provide an easy way extract a list of all folders that have files greater than 500 MB from a s3 bucket? want to limit the scope to the '/files/ftp_upload/' directories also This is so I can calculate my costs, etc. I had tried this but…
sam23
  • 49
  • 1
  • 5
0
votes
1 answer

AWS Policy to Read/write RDS

In my scenario , I want a policy that will allow reading and writing of abc-database-backups/rds/postgresql-backup on S3? We'll want the my servers to have that access added. Is creating a role and attaching it to the servers is best or adding a key…
samtech
  • 1
  • 2
0
votes
1 answer

How do I open a private static website using boto3?

I have a static website consisting of multiple HTML, CSS, and media files uploaded to a private S3 bucket. I would like to access the website using my web browser. I'm currently using boto3 to generate a presigned URL for a single HTML file. How do…
Daniel Freeman
  • 101
  • 1
1 2 3
…
74 75