0

Is SageMaker Distributed Data-Parallel (SMDDP) supported for keras models?

In documentation it says "SageMaker distributed data parallel is adaptable to TensorFlow training scripts composed of tf core modules except tf.keras modules. SageMaker distributed data parallel does not support TensorFlow with Keras implementation." https://docs.aws.amazon.com/sagemaker/latest/dg/data-parallel-modify-sdp.html

But inside the training script and how to modify it, I can see the tf.keras and tf.keras.model is used. https://sagemaker.readthedocs.io/en/stable/api/training/sdp_versions/v1.0.0/smd_data_parallel_tensorflow.html

Philipp Schmid
  • 126
  • 7

1 Answers1

1

tf.keras.Sequential model is usable. However, not all other keras submodules are available yet. This may have changed over the subsequent version releases v1.4 and v1.5

Chaitanya Bapat
  • 3,381
  • 6
  • 34
  • 59