Questions tagged [amazon-web-services]

Amazon Web Services (AWS) is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service) solutions. Only questions about programming in relation to AWS are on-topic. General server help can be obtained at https://serverfault.com. The AWS tag is rarely used alone and will usually be used with other tags to more clearly define the topic of the question.

If you need help setting up AWS resources, ask those questions on Server Fault.

AWS is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service).

SDKs to access and manage Amazon Web Services are provided in a multitude of programming languages, including PHP, Java, .NET, Node.js, Python, and more. The services are also accessible through REST and SOAP APIs, a command-line interface, and a web console.

Resources:

Related Tags

154810 questions
244
votes
11 answers

What is the best way to pass AWS credentials to a Docker container?

I am running docker-container on Amazon EC2. Currently I have added AWS Credentials to Dockerfile. Could you please let me know the best way to do this?
suraj chopade
  • 2,833
  • 3
  • 13
  • 15
241
votes
24 answers

AccessDenied for ListObjects for S3 bucket when permissions are s3:*

I am getting: An error occurred (AccessDenied) when calling the ListObjects operation: Access Denied When I try to get folder from my S3 bucket. Using this command: aws s3 cp s3://bucket-name/data/all-data/ . --recursive The IAM permissions…
user1411335
  • 3,139
  • 3
  • 18
  • 24
237
votes
18 answers

S3 Bucket action doesn't apply to any resources

I'm following the instructions from this answer to generate the follow S3 bucket policy: { "Id": "Policy1495981680273", "Version": "2012-10-17", "Statement": [ { "Sid": "Stmt1495981517155", "Action": [ "s3:GetObject" …
Philip Kirkbride
  • 21,381
  • 38
  • 125
  • 225
235
votes
19 answers

Access denied; you need (at least one of) the SUPER privilege(s) for this operation

So I try to import sql file into rds (1G MEM, 1 CPU). The sql file is like 1.4G mysql -h xxxx.rds.amazonaws.com -u user -ppass --max-allowed-packet=33554432 db < db.sql It got stuck at: ERROR 1227 (42000) at line 374: Access denied; you need (at…
kenpeter
  • 7,404
  • 14
  • 64
  • 95
235
votes
10 answers

What is the difference between Amazon ECS and Amazon EC2?

I'm just getting started on AWS EC2. I understand that EC2 is like a remote computer where I can do pretty much everything I want. Then I found out about ECS. I know it uses Docker, but I'm confused about the relationship between these two. Is ECS…
paynestrike
  • 4,348
  • 14
  • 46
  • 70
235
votes
8 answers

Open S3 object as a string with Boto3

I'm aware that with Boto 2 it's possible to open an S3 object as a string with: get_contents_as_string() Is there an equivalent function in boto3 ?
Gahl Levy
  • 3,211
  • 2
  • 13
  • 7
233
votes
3 answers

AWS VPC - Internet Gateway vs. NAT

What is an Internet Gateway? What is a NAT Instance? What services do they offer? Reading AWS VPC documentation, I gather they both map private IP addresses to internet route-able addresses for the outgoing requests and route the incoming responses…
HappyTown
  • 6,036
  • 8
  • 38
  • 51
232
votes
4 answers

What is the difference between a task and a service in AWS ECS?

It appears that one can either run a Task or a Service based on a Task Definition. What are the differences and similarities between Task and Service? Is there a clue in the fact that one can specify "Task Group" when creating Task but not Service?…
Bob Jones
  • 2,375
  • 2
  • 10
  • 5
232
votes
34 answers

How can I tell how many objects I've stored in an S3 bucket?

Unless I'm missing something, it seems that none of the APIs I've looked at will tell you how many objects are in an /. Is there any way to get a count?
fields
  • 4,433
  • 4
  • 27
  • 32
230
votes
8 answers

How do I get AWS_ACCESS_KEY_ID for Amazon?

I'm totally new to AWS. I downloaded some sample code from Amazon and I need to set a number of constants: AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY MERCHANT_ID MARKETPLACE_ID I just created an AWS account. I want some type of sandbox account so I…
Padraig
  • 3,197
  • 4
  • 18
  • 26
227
votes
8 answers

Amazon SimpleDB vs Amazon DynamoDB

I have some basic understanding what Amazon SimpleDB is, but according to the Amazon DynamoDB description it seems to be almost the same: a NoSQL Key-value store service. Can someone simply explain the main differences between them and tell in which…
227
votes
3 answers

How to rename AWS S3 Bucket

After all the tough work of migration etc, I just realised that I need to serve the content using CNAME (e.g media.abc.com). The bucket name needs to start with media.abc.com/S3/amazon.com to ensure it works perfectly. I just realised that S3…
Carson Lee
  • 2,673
  • 3
  • 20
  • 23
224
votes
13 answers

Why should I use Amazon Kinesis and not SNS-SQS?

I have a use case where there will be stream of data coming and I cannot consume it at the same pace and need a buffer. This can be solved using an SNS-SQS queue. I came to know the Kinesis solves the same purpose, so what is the difference? Why…
Apoorv
  • 2,525
  • 2
  • 14
  • 18
220
votes
11 answers

How to use multiple AWS accounts from the command line?

I've got two different apps that I am hosting (well the second one is about to go up) on Amazon EC2. How can I work with both accounts at the command line (Mac OS X) but keep the EC2 keys & certificates separate? Do I need to change my environment…
Matt Culbreth
  • 2,835
  • 2
  • 19
  • 17
220
votes
7 answers

How to make all Objects in AWS S3 bucket public by default?

I am using a PHP library to upload a file to my bucket. I have set the ACL to public-read-write and it works fine but the file is still private. I found that if I change the Grantee to Everyone it makes the file public. What I want to know is how do…
condo1234
  • 3,285
  • 6
  • 25
  • 34