Stack Overflow
Stack Overflow

Questions tagged [spot-instances]

56 questions
1
vote
1 answer

How to revive / resubmit stuck SGE jobs ( Usage of qsub? )

I am trying to revive/resubmit stuck jobs (which run on an SGE scheduler) due to a node crash or say AWS spot instances being taken away? Can someone help in resuming such jobs? I have been trying to understand the usage of qsub but not able to…
Shubham Meshram
  • 175
  • 1
  • 9
1
vote
0 answers

Using on-demand instances to fill an unfulfilled spot fleet

Let's say I set up a spot fleet with a desired count of 50 instances. Also, AWS is only able to fulfill 40 of them using spot instances, either because the spot pool is empty or because my bid price is too low. Is there something I can set up so…
David L
  • 75
  • 7
1
vote
2 answers

Cannot get public IP address of spot instance with Terraform

I’m spinning up a spot instance as you can see in below config and then trying to get the IP address from the spot. It seems to work fine with a regular ec2 instance (ie. that is not spot instance). The error that I get…
Aaron
  • 2,672
  • 10
  • 28
  • 45
1
vote
1 answer

How to get general spot instances pricing history

I would like to get spot instances pricing history for different regions and instances. I found how to get my own requests pricing history and found how to get the current spot instances pricing in the spot instance advisor But can't find how to…
thebeancounter
  • 4,261
  • 8
  • 61
  • 109
0
votes
3 answers

Not able to provision specific spot instances

I get an error "Instance Launch Failed. Max spot instance count exceeded" When I try to provision g3.16xlarge or g3.8xlarge. However I can provision g3s.xlarge and g3.4xlarge instance. The differece in the two types is the number of GPUs. The ones I…
arc
  • 71
  • 8
0
votes
0 answers

Karpenter - half of nodes state are not ready after simulate spot disruption with aws fis

I have an EKS cluster running with Karpenter provisioning. Everything worked as expected, but when I used AWS FIS to simulate spot instances interruption, I faced a weird behavior - new nodes provisioned, but half of the new nodes were stuck in not…
TanIkemen
  • 53
  • 1
  • 7
0
votes
1 answer

Is it possible to use ECS spot till it's unavailable and switch to On demand and back?

I'm reading about the ECS spot (Fargate) and the capacity provider. In the examples, I see they always create an on-demand capacity provider e.g. 1 running task, and then a spot provider with a variable amount of tasks. Is it possible to run one ECS…
DenCowboy
  • 13,884
  • 38
  • 114
  • 210
0
votes
0 answers

Spot instance with multiple instance type in autoscaling group

I have an AWS autoscaling group with spot instances and multiple instance types. I have t3a.small and t3a.micro. I want to set it up where asg always launches t3a.small and it will only launch t3a.micro when t3a.small spot is unavailable. My current…
Arghya Roy
  • 429
  • 3
  • 13
0
votes
0 answers

Not able to Access MySql server using java code that is setup on Aws Spot instance

We are using aws spot instance for dev code testing and as I am new to this environment dont have all understanding yet. I am able to connect to the mysql using terminal by following below steps ssh -i ~/.ssh/id_rsa.pub ec2-user_name@{NAT IP…
stackUser
  • 545
  • 3
  • 9
  • 21
0
votes
1 answer

Check for ec2 spot interruption notice from Lambda function

I'm currently building an application that requires quite a lot of compute resources, making me use multiple EC2s. I am trying to reduce costs by using spot instances. What I would like to do is have 2 autoscaling groups, one with spot instances and…
Alexandre_Bon
  • 126
  • 7
0
votes
0 answers

EKS Cluster Autoscaler with Spot & On-Demand Node groups

I am working on EKS Managed Node Groups using Terraform, I want to use Spot Node group as a priority & if only spot failover is there, On-demand NG should be used. And once there is available capacity in Spot NG, I want to use Spot NG back again. I…
buttercup
  • 105
  • 1
  • 12
0
votes
1 answer

Preventing an auto-terminated spot instances from restarting

Imagine I have a persistent spot request of size 1. If I manually stop this instance, it will not restart until I start it again. However, if the instance is interrupted by AWS because of a lack of spot capacity, it will restart automatically when…
BeeOnRope
  • 60,350
  • 16
  • 207
  • 386
0
votes
1 answer

Is there data for AWS spot interruption rate over time?

We are running an EMR cluster with spot instances as task nodes. The EMR cluster is executing spark jobs which sometimes run for several hours. Interruptions of spot instances can cause the failure of the spark job which then requires us to restart…
Philipp Johannis
  • 2,718
  • 1
  • 15
  • 18
0
votes
1 answer

Configure Amazon maximum percentage of OnDemand price (spot instances)

I'm playing a little with spot instances, and for example, in Databricks, I can ask for a spot instance with a minimum of % savings over On-Demand instances. My question is, if I set 90% off the On-Demand instance and the current price is 50%, I…
Alejandro
  • 519
  • 1
  • 6
  • 32
0
votes
1 answer

Is gcp removed terminated vm logs?

Is GCP Vm logs are deleted after termination of vm? I was running a GCE sopt vm with MIG(Managed Instance Group). My VM instance terminated. When i check logs of terminated Vm. I am not able to see logs of it.
holariya pankaj
  • 3
  • 1
1
2
3 4