0

My cluster sometimes gets a "burst" of information and generates a large number of Kubernetes Jobs at once. And in other times I have ~0 active jobs.

I'm wondering how can I make it autoscale the number of nodes to continuously be able to process all these jobs in a reasonable time-frame.

I specifically use AWS EKS and each job takes a few minutes to complete.

user972014
  • 3,296
  • 6
  • 49
  • 89

1 Answers1

3

EKS allows you to deploy cluster autoscaler so when new job can not be scheduled due to lack of available cpu/memory, extra node will be added to the cluster.

Ilia Kondrashov
  • 715
  • 2
  • 9
  • 14