Unity ML-Agents Running Very Slowly

Question

Using the Python API, whether I run using a build or in the Editor the simulation is much slower than when using the provided mlagents-learn methods. I'm running something similar to this, using a PyTorch implementation of DDPG and CUDA 9.0. Is this expected behaviour?

Answer 1

Got to the Academy's proprieties and make sure that the value of Time Scale in the Inference Configuration is equals to the Training Configuration's one.

For other info check the official documentation of ML-Agents at Learning-Environment-Design-Academy

Answer 2

To use deep reinforcement learning models you have to use unityagents 0.4, and in 0.4 version how are you using mlagents-learn. It supports different commands.