Stack Overflow
Stack Overflow

Questions tagged [boto]

boto is an open-source Python Interface to Amazon Web Services

Boto is a Python package that provides an interface to Amazon Web Services. The code is hosted on github.com (https://github.com/boto/boto) and the documentation can be found at http://docs.pythonboto.org.

Boto supports the following services:

  • Compute
    • Amazon Elastic Compute Cloud (EC2)
    • Amazon Elastic Map Reduce (EMR)
    • AutoScaling
    • Elastic Load Balancing (ELB)
  • Content Delivery
    • Amazon CloudFront
  • Database
    • Amazon Relational Data Service (RDS)
    • Amazon DynamoDB
    • Amazon SimpleDB
  • Deployment and Management
    • AWS Identity and Access Management (IAM)
    • Amazon CloudWatch
    • AWS Elastic Beanstalk
    • AWS CloudFormation
  • Application Services
    • Amazon CloudSearch
    • Amazon Simple Workflow Service (SWF)
    • Amazon Simple Queue Service (SQS)
    • Amazon Simple Notification Server (SNS)
    • Amazon Simple Email Service (SES)
  • Networking
    • Amazon Route53
    • Amazon Virtual Private Cloud (VPC)
  • Payments and Billing
    • Amazon Flexible Payment Service (FPS)
  • Storage
    • Amazon Simple Storage Service (S3)
    • Amazon Glacier
    • Amazon Elastic Block Store (EBS)
    • Google Cloud Storage
  • Workforce
    • Amazon Mechanical Turk
  • Other
    • Marketplace Web Services
2362 questions
27
votes
10 answers

PyCharm intellisense for boto3

having problems seeing full intellisense (code completion) options in PyCharm. working with python 3.4 on Windows. the suggests are partially working: import boto3 s = boto3.Session() (boto3. will bring up list of methods/params of object…
Alex C
  • 503
  • 1
  • 4
  • 10
27
votes
3 answers

How to launch EC2 instance with Boto, specifying size of EBS?

I'm using boto/python to launch a new EC2 instance that boots from an EBS volume. At the time I launch the instance, I'd like to override the default size of the booting EBS volume. I found no boto methods or parameters that might fit into my…
Iron Pillow
  • 2,152
  • 4
  • 20
  • 29
27
votes
4 answers

How to check User Data status while launching the instance in aws

I am trying to launch aws instance with User Data. My User Data is a server installation process and i have to check whether the user data scripts are executed properly. Is there any option to check if the status of User data is completed ? I need…
Naveen Subramani
  • 2,134
  • 7
  • 20
  • 27
26
votes
3 answers

Best practice for polling an AWS SQS queue and deleting received messages from queue?

I have an SQS queue that is constantly being populated by a data consumer and I am now trying to create the service that will pull this data from SQS using Python's boto. The way I designed it is that I will have 10-20 threads all trying to read…
Mo.
  • 40,243
  • 37
  • 86
  • 131
26
votes
5 answers

AWS cloudformation: One big template file or many small ones?

I'm about to rewrite a lot of my aws deployment code to launch everything with cloudformation controlled by boto, instead of bringing up each element on its own with boto. Does anyone know if its "best practice" to use one giant template file, which…
TristanMatthews
  • 2,451
  • 4
  • 24
  • 34
26
votes
1 answer

Release a message back to SQS

I have a some EC2 servers pulling work off of a SQS queue. Occasionally, they encounter a situation where the can't finish the job. I have the process email me of the condition. As it stands now, the message stays "in flight" until it times out. …
David S
  • 12,967
  • 12
  • 55
  • 93
26
votes
6 answers

How to get all messages in Amazon SQS queue using boto library in Python?

I'm working on an application whose workflow is managed by passing messages in SQS, using boto. My SQS queue is growing gradually, and I have no way to check how many elements it is supposed to contain. Now I have a daemon that periodically polls…
Charles Menguy
  • 40,830
  • 17
  • 95
  • 117
25
votes
3 answers

Storing images and thumbnails on s3 in django

I'm trying to get my images thumbnailed and stored on s3 using django-storages, boto, and sorl-thumbnail. I have it working, but it's very slow, even with small images. I don't mind it being slow when I save the form and upload the images to s3, but…
asciitaxi
  • 1,369
  • 1
  • 16
  • 16
25
votes
7 answers

Boto3 error: The AWS Access Key Id you provided does not exist in our records

I am currently trying to get access to Amazon S3 inside a virtual machine and download files like so: s3 = boto3.resource('s3', aws_access_key_id="xxxxxxxxxxx", aws_secret_access_key="xxxxxxxxxxxxxxxxx") s3client =…
Jo Ko
  • 7,225
  • 15
  • 62
  • 120
25
votes
4 answers

How to create a s3 bucket using Boto3?

I want to enable cloudtrail logs for my account and so need to create an s3 bucket.I wanted to automate this task using Boto3.Currently I am using the following script sess = Session(aws_access_key_id=tmp_access_key, …
tom
  • 3,720
  • 5
  • 26
  • 48
24
votes
5 answers

How to use the AWS Python SDK while connecting via SSO credentials

I am attempting to create a python script to connect to and interact with my AWS account. I was reading up on it here https://boto3.amazonaws.com/v1/documentation/api/latest/guide/quickstart.html and I see that it reads your credentials from…
user1015214
  • 2,733
  • 10
  • 36
  • 66
24
votes
2 answers

boto issue with IAM role

I'm trying to use AWS' recently announced "IAM roles for EC2" feature, which lets security credentials automatically get delivered to EC2 instances. (see…
Nils
  • 5,612
  • 4
  • 34
  • 37
23
votes
3 answers

With boto, how can I name a newly spawned EC2 instance?

I'm using boto to spawn a new EC2 instance based on an AMI. The ami.run method has a number of parameters, but none for "name" - maybe it's called something different?
Jeff
  • 2,778
  • 6
  • 23
  • 27
23
votes
8 answers

[Django][AWS S3] botocore.exceptions.clienterror an error occurred (accessdenied) when calling the PutObject operation

I am trying to connect Django project to AWS S3. settings.py contains below: AWS_ACCESS_KEY_ID = #ID AWS_SECRET_ACCESS_KEY = #Key AWS_STORAGE_BUCKET_NAME = #Bucket AWS_S3_CUSTOM_DOMAIN = '%s.s3.amazonaws.com' %…
yoon
  • 1,177
  • 2
  • 15
  • 28
23
votes
3 answers

Read a csv file from aws s3 using boto and pandas

I have already read through the answers available here and here and these do not help. I am trying to read a csv object from S3 bucket and have been able to successfully read the data using the following code. srcFileName="gossips.csv" def…
Drj
  • 1,176
  • 1
  • 11
  • 26
1 2 3
…
99 100