Stack Overflow
Stack Overflow

Questions tagged [spot-instances]

56 questions
0
votes
0 answers

AWS - Use AMI from other account

I want to use AMI which is located in another account to create spot instance with Terraform. AMI is shared with my account but EBS inside of it is created with custom KMS. When I tried to use the AMI, it gave an error like below. Instance launch…
nevincansel
  • 23
  • 5
0
votes
1 answer

When creating an AWS Auto-Scaling Launch Configuration & using spot instances - How can I set a maximum price based on unit type?

I regularly am seeing the following througout various AWS documentation: If you set TargetCapacityUnitType to vcpu or memory-mib , the price protection threshold is applied based on the per-vCPU or per-memory price instead of the per-instance…
TJ Biddle
  • 6,024
  • 6
  • 40
  • 47
0
votes
1 answer

Is SageMaker multi-node Spot-enabled GPU training an anti-pattern?

Is it an anti-pattern to do multi-node Spot-enabled distributed GPU training on SageMaker? I'm afraid that several issues will slow things down or even make them infeasible: the interruption detection lag the increased probability of interruption…
juvchan
  • 6,113
  • 2
  • 22
  • 35
0
votes
0 answers

Why does this Jenkins job not consistently retry when my spot instance gets interrupted?

I've been trying to get our CI job in Jenkins to run on spot instances in EC2 (using the Amazon EC2 plugin), and I'm having trouble figuring out how to retry consistently when they get interrupted. The test run is parallelized across several Jenkins…
Cody
  • 2,467
  • 2
  • 21
  • 30
0
votes
1 answer

Spotinst plugin exited before we could connect on terraform

I wanted to run our terraform code for a small change today. But I started to get this error: provider.spotinst: plugin exited before we could connect plugin exited before we could connect` We use this terraform code for a long time. And our version…
sbb
  • 529
  • 3
  • 25
0
votes
1 answer

Using GPU Spot Instance(s) for SageMaker Distributed Training?

I have a requirement to use N 1x GPU Spot instances instead of 1x N-GPU instance for distributed training. Does SageMaker Distributed Training support the use of GPU Spot instance(s)? If yes, how to enable it?
juvchan
  • 6,113
  • 2
  • 22
  • 35
0
votes
1 answer

Task takes too much time pending on ECS

I've been with a weird problem for some days. I'm implementing the ECS logic to drain instances on termination (specifically on Spot interruption notice) using the ECS_ENABLE_SPOT_INSTANCE_DRAINING=true env var on the ecs-agent. The process works…
DGomez
  • 1,450
  • 9
  • 25
0
votes
0 answers

Does manually terminating a spot instance following an interruption notice and within the first hour incur charges?

I am using EC2 Spot Instance interruption notices to architect a fault tolerant application running on Amazon Linux. On receiving the warning, some logs are stored and I no longer need the instance for the upcoming 2 minutes. If Amazon EC2…
Ahmed Sheashaa
  • 132
  • 2
  • 11
0
votes
1 answer

Avoid Running specific ECS tasks on SPOT Instances

I have 16 microservices running in an ECS AWS Cluster. I have some EC2 instances mixed with spot instances. Some of the microservices are CORE, and should not be deployed on SPOT instances. How can I achieve to avoid deploying certain services on…
Jocheinfa
  • 25
  • 1
  • 4
0
votes
0 answers

How to access large amount of csv files Data from aws EC2 instance to in multiple Spot Instances?

I have 5 years of Stock market data, and strategies which I regularly run on my local machine, but I felt that my local machine takes so much time for processing that data. so I decided to process my data in was server. So I did little research…
Krishna Gupta
  • 166
  • 1
  • 10
0
votes
1 answer

How efficient is to use EMR spot instances to run spark jobs?

I want to use EMR spot instances to cut down my Redshift and aws glue costs, but after reading about them I want to know if I am running a 30 mins jobs how likely is it to get interrupted , How often these spot instances are taken away while running…
bigDataArtist
  • 141
  • 1
  • 12
0
votes
0 answers

Temporarily running a start-up solely on EC2 spot instances?

I have a start-up company (USA) that will be running on AWS and have the idea to use ONLY Spot Instances (until further funding is acquired) for our initial 2-4 month launch in order to save the maximum amount of money by constantly monitoring our…
Jake Smith
  • 580
  • 3
  • 11
0
votes
1 answer

Is there a benefit to having spare nodes for handling EC2 spot interruption node termination event?

Suppose I have a 3 node EKS cluster made up of 3 spot instances (we'll call them Node A, B, and C), and each node has critical pods scheduled. The EKS cluster has the EKS Node Termination Handler running. Metadata gets posted saying that in 2…
Christian Aranda
  • 91
  • 4
0
votes
2 answers

aws cloudformation template for spot request in ec2 instance

I need a sample cloud formation template to add spot requests while provisioning the ec2 instance in AWS.I have tried with console to provision spot instances but I couldn't find any exact template for add spot request in ec2
arya b raj
  • 13
  • 2
0
votes
1 answer

NodeSelector does not work for multiple node pools?

TL;DR: NodeSelector ignores nodes from another NodePool. How to distribute pods across more NodePools using a label nodeSelector or other technique? I have two nodePools like this: ... # Spot node pool resource…
rudolfdobias
  • 1,778
  • 3
  • 17
  • 40
1 2
3
4