Stack Overflow
Stack Overflow

Questions tagged [amazon-web-services]

Amazon Web Services (AWS) is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service) solutions. Only questions about programming in relation to AWS are on-topic. General server help can be obtained at https://serverfault.com. The AWS tag is rarely used alone and will usually be used with other tags to more clearly define the topic of the question.

If you need help setting up AWS resources, ask those questions on Server Fault.

AWS is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service).

SDKs to access and manage Amazon Web Services are provided in a multitude of programming languages, including PHP, Java, .NET, Node.js, Python, and more. The services are also accessible through REST and SOAP APIs, a command-line interface, and a web console.

Resources:

Related Tags

154810 questions
104
votes
10 answers

How list Amazon S3 bucket contents by modified date?

Most of the time it happens that we load files in a common S3 bucket due to which it becomes hard to figure out data in it. How can I view objects uploaded on a particular date?
azhar22k
  • 4,765
  • 4
  • 21
  • 24
104
votes
2 answers

When to use a boto3 client and when to use a boto3 resource?

I am trying to understand when I should use a Resource and when I should use a Client. The definitions provided in boto3 docs don't really make it clear when it is preferable to use one or the other.
aquil.abdullah
  • 3,059
  • 3
  • 21
  • 40
104
votes
9 answers

Listing files in a specific "folder" of a AWS S3 bucket

I need to list all files contained in a certain folder contained in my S3 bucket. The folder structure is the following /my-bucket/users//contacts/ I have files related to users and files related to a certain user's contact. I…
davioooh
  • 23,742
  • 39
  • 159
  • 250
104
votes
12 answers

how to clean up docker overlay directory?

I'm running docker via CoreOS and AWS's ECS. I had a failing image that got restarted many times, and the containers are still around- they filled my drive partition. Specifically, /var/lib/docker/overlay/ contains a large number of…
tedder42
  • 23,519
  • 13
  • 86
  • 102
103
votes
9 answers

AWS Lambda Error: "Cannot find module '/var/task/index'"

Node.js Alexa Task Issue I'm currently coding a Node.js Alexa Task via AWS Lambda, and I have been trying to code a function that receives information from the OpenWeather API and parses it into a variable called weather. The relevant code is as…
Anthony Krivonos
  • 4,596
  • 4
  • 16
  • 31
103
votes
10 answers

Complete scan of dynamoDb with boto3

My table is around 220mb with 250k records within it. I'm trying to pull all of this data into python. I realize this needs to be a chunked batch process and looped through, but I'm not sure how I can set the batches to start where the previous…
CJ_Spaz
  • 1,134
  • 2
  • 7
  • 10
102
votes
4 answers

Is there a way to set Amazon AWS billing limit?

I'm building app on top of Amazon S3. How can I keep my S3 running under a set budget? Suppose I don't want unexpected traffic to over charge my AWS account. I'd rather it remain unavailable.
Clark
  • 2,893
  • 5
  • 23
  • 25
102
votes
1 answer

Difference between AWS DynamoDB vs. AWS DocumentDB(Newly launched service)?

AWS recently launched new service DocumentDB similar to MongoDB interface. What is the difference between AWS DynamoDB vs. DocumentDB services?
Ajay yadav
  • 4,141
  • 4
  • 31
  • 40
102
votes
4 answers

Difference between upload() and putObject() for uploading a file to S3?

In the aws-sdk's S3 class, what is the difference between upload() and putObject()? They seem to do the same thing. Why might I prefer one over the other?
callum
  • 34,206
  • 35
  • 106
  • 163
102
votes
16 answers

How do I find the total size of my AWS S3 storage bucket or folder?

Does Amazon provide an easy way to see how much storage my S3 bucket or folder is using? This is so I can calculate my costs, etc.
VernonFuller
  • 1,445
  • 2
  • 10
  • 10
101
votes
3 answers

Boto3/S3: Renaming an object using copy_object

I'm trying to rename a file in my s3 bucket using python boto3, I couldn't clearly understand the arguments. can someone help me here? What I'm planing is to copy object to a new object, and then delete the actual object. I found similar questions…
MikA
  • 5,184
  • 5
  • 33
  • 42
100
votes
1 answer

How do you comment out lines in AWS CLI config and credentials files?

For AWS CLI configuration and credentials files how do you comment out lines in these files - I checked the documentation here http://docs.aws.amazon.com/cli/latest/userguide/cli-chap-getting-started.html#cli-config-files but found…
kellyfj
  • 6,586
  • 12
  • 45
  • 66
100
votes
5 answers

Self-Terminating AWS EC2 Instance?

Is there a way that Amazon Web Services EC2 instances can be self terminating? Does Amazon have anything that allows an instance to terminate itself ("Hara-Kiri") after running for more than say an hour? I could change the scripts on the running…
Steve3p0
  • 2,332
  • 5
  • 22
  • 30
99
votes
13 answers

Installing PostgreSQL Client v10 on AWS Amazon Linux (EC2) AMI

I have successfully launched new AWS RDS PostgreSQL v10 instance and need to install PostgreSQL v10 client on Amazon Linux EC2 instance. I have tried to install it with yum, but it cant find the package for v10: [ec2-user@ip-X-X-X-X ~]$ sudo yum…
Ismar Slomic
  • 5,315
  • 6
  • 44
  • 63
99
votes
6 answers

How enable access to AWS STS AssumeRole

I am getting an error when calling to assume role method of STS. It says that the user is not authorized to perform sts:AsumeRole on resource xxx. I did the following: I created a role to access to S3 bucket. I ran a test over policy simulator and…
Vladimir Venegas
  • 3,894
  • 5
  • 25
  • 45
1 2 3
…
99 100