Using the Python API, whether I run using a build or in the Editor the simulation is much slower than when using the provided mlagents-learn
methods. I'm running something similar to this, using a PyTorch implementation of DDPG and CUDA 9.0. Is this expected behaviour?
Got to the Academy
's proprieties and make sure that the value of Time Scale
in the Inference Configuration
is equals to the Training Configuration
's one.
For other info check the official documentation of ML-Agents at Learning-Environment-Design-Academy