0

I want to perform distributed training on Amazon SageMaker. The code is written with TensorFlow and similar to the following code where I think CPU instance should be enough:  https://github.com/horovod/horovod/blob/master/examples/tensorflow_word2vec.py

Can Horovod with TensorFlow work on non-GPU instances in Amazon SageMaker?

juvchan
  • 6,113
  • 2
  • 22
  • 35

1 Answers1

0

Yeah you should be able to use both CPU's and GPU's with Horovod on Amazon SageMaker. Please follow the below example for the same

https://github.com/aws/amazon-sagemaker-examples/blob/main/sagemaker-python-sdk/tensorflow_script_mode_horovod/tensorflow_script_mode_horovod.ipynb

Arun Lokanatha
  • 290
  • 1
  • 4