Questions tagged [amazon-web-services]

Amazon Web Services (AWS) is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service) solutions. Only questions about programming in relation to AWS are on-topic. General server help can be obtained at https://serverfault.com. The AWS tag is rarely used alone and will usually be used with other tags to more clearly define the topic of the question.

If you need help setting up AWS resources, ask those questions on Server Fault.

AWS is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service).

SDKs to access and manage Amazon Web Services are provided in a multitude of programming languages, including PHP, Java, .NET, Node.js, Python, and more. The services are also accessible through REST and SOAP APIs, a command-line interface, and a web console.

Resources:

Related Tags

154810 questions
216
votes
4 answers

How can I use wildcards to `cp` a group of files with the AWS CLI?

I'm having trouble using * in the AWS CLI to select a subset of files from a certain bucket. Adding * to the path like this does not seem to work: aws s3 cp s3://data/2016-08* .
metersk
  • 11,803
  • 21
  • 63
  • 100
216
votes
8 answers

Downloading folders from aws s3, cp or sync?

If I want to download all the contents of a directory on S3 to my local PC, which command should I use cp or sync ? Any help would be highly appreciated. For example, if I want to download all the contents of "this folder" to my desktop, would it…
BFlint
  • 2,407
  • 2
  • 16
  • 20
215
votes
19 answers

How to see all running Amazon EC2 instances across all regions?

I switch instances between different regions frequently and sometimes I forget to turn off my running instance from a different region. I couldn't find any way to see all the running instances on Amazon console. Is there any way to display all the…
GorvGoyl
  • 42,508
  • 29
  • 229
  • 225
213
votes
7 answers

How to specify credentials when connecting to boto3 S3?

On boto I used to specify my credentials when connecting to S3 in such a way: import boto from boto.s3.connection import Key, S3Connection S3 = S3Connection( settings.AWS_SERVER_PUBLIC_KEY, settings.AWS_SERVER_SECRET_KEY ) I could then use S3 to…
Robert Brax
  • 6,508
  • 12
  • 40
  • 69
212
votes
22 answers

How do you search an amazon s3 bucket?

I have a bucket with thousands of files in it. How can I search the bucket?
vinhboy
  • 8,542
  • 7
  • 34
  • 44
211
votes
27 answers

Missing Authentication Token while accessing API Gateway?

I am trying to call a Lambda Function through AWS API Gateway. When I mention Authentication type NONE it works fine but API become public and anyone with url can access my API. To make API call secure, I am using Authentication type AWS_IAM and…
Umer Waheed
  • 4,044
  • 7
  • 41
  • 62
203
votes
34 answers

How can I resolve the error "The security token included in the request is invalid" when running aws iam upload-server-certificate?

I cd into the directory where all the pem/key files are and run the following: aws iam upload-server-certificate --server-certificate-name certificate_name --certificate-body file://webservercertificate.pem --private-key…
Killesk
  • 2,734
  • 3
  • 22
  • 29
201
votes
14 answers

How to change User Status FORCE_CHANGE_PASSWORD?

Using AWS Cognito, I want to create dummy users for testing purposes. I then use the AWS Console to create such user, but the user has its status set to FORCE_CHANGE_PASSWORD. With that value, this user cannot be authenticated. Is there a way to…
Dominique Vial
  • 3,729
  • 2
  • 25
  • 45
200
votes
28 answers

Increasing client_max_body_size in Nginx conf on AWS Elastic Beanstalk

I'm running into "413 Request Entity Too Large" errors when posting files larger than 10MB to our API running on AWS Elastic Beanstalk. I've done quite a bit of research and believe that I need to up the client_max_body_size for Nginx, however I…
199
votes
8 answers

How to write a file or data to an S3 object using boto3

In boto 2, you can write to an S3 object using these methods: Key.set_contents_from_string() Key.set_contents_from_file() Key.set_contents_from_filename() Key.set_contents_from_stream() Is there a boto 3 equivalent? What is the boto3 method for…
jkdev
  • 11,360
  • 15
  • 54
  • 77
198
votes
2 answers

What is "EC2-Other" filter in "Cost Explorer" dashboard mean?

While investigating AWS Bill using Cost Explorer tool, I selected EC2-Other filter under services and it showed an amount around 5k monthly but I still don’t know what capabilities (features or services) are costing all this amount. What does…
Ammar Badran
  • 2,089
  • 2
  • 6
  • 5
198
votes
12 answers

Extension exists but uuid_generate_v4 fails

At amazon ec2 RDS Postgresql: => SHOW rds.extensions; rds.extensions …
Incerteza
  • 32,326
  • 47
  • 154
  • 261
198
votes
10 answers

AWS Error Message: A conflicting conditional operation is currently in progress against this resource

I'm getting this error intermittently. I have a program that uses the java aws sdk and loads over the 10s of thousands of small files to s3. I see this error intermittently. Could not find any helpful answer after doing a quick search on the…
user1172468
  • 5,306
  • 6
  • 35
  • 62
195
votes
7 answers

DynamoDB vs MongoDB NoSQL

I'm trying to figure out what can I use for a future project, we plan to store about 500k records per month in the first year and maybe more for the next years this is a vertical application so there's no need to use a database for this, that's the…
pedrommuller
  • 15,741
  • 10
  • 76
  • 126
190
votes
19 answers

Configuring region in Node.js AWS SDK

Can someone explain how to fix a missing config error with Node.js? I've followed all the examples from the aws doc page but I still get this error no matter what. { [ConfigError: Missing region in config] message: 'Missing region in config', code:…
Anejah Daniels
  • 1,901
  • 2
  • 10
  • 4