30

I have a function which perform some mathematical operations and need a 16gb GPU system, But this function will not be triggered always and rest of time my system will not be in use. I came to know about AWS Lambda. Can I run GPU based algorithm on Lambda?? So that whenever I need GPU, I will get the system on cloud. I need a little description about it.

Cœur
  • 37,241
  • 25
  • 195
  • 267
Amar Malik
  • 477
  • 1
  • 4
  • 14

3 Answers3

21

You can't specify the runtime environment for AWS Lambda functions, so no, you can't require the presence of a GPU (in fact the physical machines AWS chooses to put into its Lambda pool will almost certainly not have one).

Your best bet would be to run the GPU-requiring function as a Batch job on a compute cluster configured to use p-type instances. The guide here might be helpful.

Stephen
  • 1,657
  • 13
  • 10
10

Currently lambda doesn't have GPU.

However, if you just need to do inference; the emulation via CPU works fine on AWS lambda; here is an article that goes into more details:

https://aws.amazon.com/blogs/machine-learning/how-to-deploy-deep-learning-models-with-aws-lambda-and-tensorflow/

Neil
  • 7,482
  • 6
  • 50
  • 56
3

Batch is a good solution for certain types of workload. Another option is GPUs on ECS, which could be used for running frequent tasks utilising GPU.

Matt D
  • 3,289
  • 1
  • 15
  • 29