Questions tagged [amazon-web-services]

Amazon Web Services (AWS) is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service) solutions. Only questions about programming in relation to AWS are on-topic. General server help can be obtained at https://serverfault.com. The AWS tag is rarely used alone and will usually be used with other tags to more clearly define the topic of the question.

If you need help setting up AWS resources, ask those questions on Server Fault.

AWS is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service).

SDKs to access and manage Amazon Web Services are provided in a multitude of programming languages, including PHP, Java, .NET, Node.js, Python, and more. The services are also accessible through REST and SOAP APIs, a command-line interface, and a web console.

Resources:

Related Tags

154810 questions
95
votes
16 answers

Missing credentials in config, if using AWS_CONFIG_FILE, set AWS_SDK_LOAD_CONFIG=1

When I am trying to load AWS credentials in my project it gives back an error. When using credentials in plain text everything works good but when I am trying to use environment variables it's not working. Error message. : Missing credentials in…
singh singh
  • 963
  • 1
  • 6
  • 10
95
votes
9 answers

How to temporarily switch profiles for AWS CLI?

Updated answer (7/10/2021): For AWS CLI v1, do this: export AWS_DEFAULT_PROFILE=user2 For AWS CLI v2, the following will work: export AWS_PROFILE=user2 The full question is below for context: (1.) After successfully configuring a second profile…
James Shapiro
  • 4,805
  • 3
  • 31
  • 46
95
votes
11 answers

The role defined for the function cannot be assumed by Lambda

I'm getting the error "The role defined for the function cannot be assumed by Lambda" when I'm trying to create a lambda function with create-function command. aws lambda create-function --region us-west-2 --function-name HelloPython …
Midhun Sudhakar
  • 1,238
  • 2
  • 10
  • 14
95
votes
14 answers

Auto Shutdown and Start Amazon EC2 Instance

Can I automatically start and terminate my Amazon instance using Amazon API? Can you please describe how this can be done? I ideally need to start the instance and stop the instance at specified time intervals every day.
Pasta
  • 2,491
  • 5
  • 24
  • 33
95
votes
3 answers

Kafka or SNS or something else?

Sorry if it is a newbie question. But I'm trying to understand what should I use. As far as I understand Kafka is : Apache Kafka is a distributed publish-subscribe messaging system. And SNS is also pub/sub system. My goal is to use some queue…
Vor
  • 33,215
  • 43
  • 135
  • 193
95
votes
7 answers

Is it possible to perform a batch upload to amazon s3?

Does amazon s3 support batch uploads? I have a job that needs to upload each night ~100K of files that can be up to 1G but is strongly skewed towards small files (90% are less than 100 bytes and 99% are less than 1000 bytes long). Does the s3 API…
flybywire
  • 261,858
  • 191
  • 397
  • 503
94
votes
25 answers

Row was updated or deleted by another transaction (or unsaved-value mapping was incorrect)

I have a java project that runs on a webserver. I always hit this exception. I read some documentation and found that pessimistic locking (or optimistic, but I read that pessimistic is better) is the best way to prevent this exception. But I…
94
votes
13 answers

How to list all AWS S3 objects in a bucket using Java

What is the simplest way to get a list of all items within an S3 bucket using Java? List s3objects = s3.listObjects(bucketName,prefix).getObjectSummaries(); This example only returns 1000 items.
Ron D.
  • 3,774
  • 6
  • 31
  • 39
94
votes
2 answers

Should I use AWS Elastic Beanstalk or the Amazon EC2 Container Service (ECS) to scale Docker containers?

I've developed a Docker based application comprised of multiple microservices. It has to consume Amazon SQS messages and processes them. At first I wanted to use AWS Elastic Beanstalk, but then I fell over the EC2 Container Service. Now I don't know…
93
votes
7 answers

aws lambda: Error: Runtime exited with error: signal: killed

I'm trying to pull a large file from S3 and write it to RDS using pandas dataframes. I've been googling this error and haven't seen it anywhere, does anyone know what this extremely generic sounding error could mean? I've encountered memory issues…
Matt Takao
  • 2,406
  • 3
  • 16
  • 30
93
votes
7 answers

S3 limit to objects in a bucket

Does anyone know if there is a limit to the number of objects I can put in an S3 bucket? can I put a million, 10 million etc.. all in a single bucket?
Quotient
  • 3,925
  • 6
  • 31
  • 35
93
votes
7 answers

Push docker image to amazon ecs repository

Im new to AWS. I want to set up a private docker repository on an AWS ECS container instance. I created a repository named name. The example push commands shown by AWS are working. aws ecr get-login --region us-west-2 docker build -t name . docker…
Ohmen
  • 6,194
  • 3
  • 25
  • 35
93
votes
12 answers

How to set the time zone in Amazon EC2?

I want to change the time zone set in my Amazon EC2 instance running Ubuntu Linux to local time? My Question How to change the time zone in Amazon EC2?
Gaurav Agarwal
  • 18,754
  • 29
  • 105
  • 166
92
votes
1 answer

Is it possible to change the availability zone of an existing EC2 t1.micro instance?

Sometimes when trying to launch my t1.micro EC2 instance, it cannot be provisioned and Amazon recommends trying a different availability zone. Is it possible to change this for an existing instance?
anon
  • 4,163
  • 3
  • 29
  • 26
92
votes
10 answers

How could I determine which AWS location is best for serving customers from a particular region?

AWS has several locations for storage and EC2 instances to run upon with different pricing. How could I determine which location is best for a particular region. Is it intuitive (closer to your serving region is the best) or are there any…
Gagandeep Singh
  • 5,755
  • 4
  • 41
  • 60