Questions tagged [amazon-web-services]

Amazon Web Services (AWS) is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service) solutions. Only questions about programming in relation to AWS are on-topic. General server help can be obtained at https://serverfault.com. The AWS tag is rarely used alone and will usually be used with other tags to more clearly define the topic of the question.

If you need help setting up AWS resources, ask those questions on Server Fault.

AWS is a cloud service that offers IaaS (Infrastructure as a Service) and SaaS (Software as a Service).

SDKs to access and manage Amazon Web Services are provided in a multitude of programming languages, including PHP, Java, .NET, Node.js, Python, and more. The services are also accessible through REST and SOAP APIs, a command-line interface, and a web console.

Resources:

Related Tags

154810 questions
131
votes
9 answers

MySQL/Amazon RDS error: "you do not have SUPER privileges..."

I'm attempting to copy my mysql database from an Amazon EC2 to an RDS: I successfully did a mysqldump of my database into my root folder using this: root@ip-xx-xx-xx-xx:~# mysqldump my_database -u my_username -p > my_database.sql Then I tried to…
tim peterson
  • 23,653
  • 59
  • 177
  • 299
130
votes
17 answers

AWS CLI $PATH Settings

I am following the AWS CLI Setup guide. I have managed to successfully install the tool on my Mac OS X terminal with the following output: Running cmd: /usr/bin/python virtualenv.py --python /usr/bin/python /Users/fr/.local/lib/aws Running cmd:…
fr_muses
  • 1,475
  • 2
  • 10
  • 10
130
votes
4 answers

AWS MySQL RDS vs AWS DynamoDB

I've been using MySQL for a fair while now and I'm comfortable with its structure & SQL Queries etc. Currently building a new system in AWS and I've been looking at DynamoDB. Currently I only know a little about it. Is one better then the other?…
Adam
  • 19,932
  • 36
  • 124
  • 207
130
votes
10 answers

Amazon S3 upload file and get URL

Is it possible to upload a txt/pdf/png file to Amazon S3 in a single action, and get the uploaded file URL as the response? If so, is AWS Java SDK the right library that I need to add in my java struts2 web application? Please suggest me a solution…
Sangram Anand
  • 10,526
  • 23
  • 70
  • 103
129
votes
5 answers

How to create an SSH key in Terraform?

I need to spin up a bunch of EC2 boxes for different users. Each user should be sandboxed from all the others, so each EC2 box needs its own SSH key. What's the best way to accomplish this in Terraform? Almost all of the instructions I've found want…
Abe
  • 22,738
  • 26
  • 82
  • 111
128
votes
8 answers

S3 - What Exactly Is A Prefix? And what Ratelimits apply?

I was wondering if anyone knew what exactly an s3 prefix was and how it interacts with amazon's published s3 rate limits: Amazon S3 automatically scales to high request rates. For example, your application can achieve at least 3,500…
dm03514
  • 54,664
  • 18
  • 108
  • 145
127
votes
19 answers

Query EC2 tags from within instance

Amazon recently added the wonderful feature of tagging EC2 instances with key-value pairs to make management of large numbers of VMs a bit easier. Is there some way to query these tags in the same way as some of the other user-set data? For…
Josh Lindsey
  • 8,455
  • 3
  • 24
  • 25
127
votes
18 answers

Boto3 to download all files from a S3 Bucket

I'm using boto3 to get files from s3 bucket. I need a similar functionality like aws s3 sync My current code is #!/usr/bin/python import boto3 s3=boto3.client('s3') list=s3.list_objects(Bucket='my_bucket_name')['Contents'] for key in list: …
Shan
  • 2,141
  • 2
  • 17
  • 32
127
votes
3 answers

Cost of storing AMI

I understand Amazon will charge per GB provisioned EBS storage. If I create AMI of my instance, does this mean my EBS volume will be duplicated, and hence incur additional cost? Is there other cost charge in creating and storing an AMI (Amazon…
gerrytan
  • 40,313
  • 9
  • 84
  • 99
126
votes
8 answers

Can I change the root EBS device of my amazon EC2 instance?

I have an EBS backed Amazon EC2 instance. I would like to change the root device on this instance. Can you please advise the best way to go about this? I only find documentation on changing several attributes of block devices, but they don't seem to…
cone
  • 1,665
  • 3
  • 13
  • 13
126
votes
9 answers

AccessDeniedException: User is not authorized to perform: lambda:InvokeFunction

I'm trying to invoke a lambda function from node. var aws = require('aws-sdk'); var lambda = new aws.Lambda({ accessKeyId: 'id', secretAccessKey: 'key', region: 'us-west-2' }); lambda.invoke({ FunctionName: 'test1', Payload:…
Arjun Komath
  • 2,802
  • 4
  • 16
  • 24
125
votes
10 answers

ImportError: cannot import name 'joblib' from 'sklearn.externals'

I am trying to load my saved model from s3 using joblib import pandas as pd import numpy as np import json import subprocess import sqlalchemy from sklearn.externals import joblib ENV = 'dev' model_d2v = load_d2v('model_d2v_version_002', ENV) def…
Praneeth Sai
  • 1,421
  • 2
  • 7
  • 11
125
votes
3 answers

Use terraform to set up a lambda function triggered by a scheduled event source

I would like to run an AWS lambda function every five minutes. In the AWS Management Console this is easy to set up, under the lambda function's "Event Sources" tab, but how do I set it up with Terraform? I tried to use an…
Vebjorn Ljosa
  • 17,438
  • 13
  • 70
  • 88
125
votes
16 answers

AWS S3 display file inline instead of force download

For some reason files in my S3 bucket are being forced as downloads instead of displaying in-line so if I copy an image link and paste it into address bar and then navigate to it, it will promote my browser to download it. Instead I actually have to…
Cl'
  • 1,535
  • 2
  • 10
  • 17
124
votes
1 answer

What's special about 169.254.169.254 IP address for AWS?

This IP seems to be running a service that provides a lot of useful metadata for my instance, but I'm wondering why 169.254.169.254? What's special about that IP address? And also wondering if the fact of having that IP occupied by that service I'm…
AlexStack
  • 16,766
  • 21
  • 72
  • 104