The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source Unity3D plugin that enables games and simulations to serve as environments for training intelligent agents. Agents - usually implemented as scripted C# Unity components - can be trained using reinforcement learning, imitation learning, neuroevolution, or other machine learning methods through a Python API.
Questions tagged [ml-agent]
103 questions
1
vote
0 answers
About Using Unity:ML-Agents and DQN Algorithm
I am having difficulty learning by connecting the external API and the unity environment I have created.
I was looking at the previous ml-agent version of DQN code and wanted to use the following code.
How should I use this in the current version?
#…

LeeJaeWon
- 21
- 2
1
vote
1 answer
Ml-agents cooperative push block not returning rewards
I'm working with the Cooperative push block environment ( https://github.com/Unity-Technologi...nvironment-Examples.md#cooperative-push-block) (exported in order to use the Python API) using the latest stable version. The issue is that I'm not…

escribano101
- 23
- 4
1
vote
0 answers
Can't use trained model on older version of ML-agents from Unity
I'm training with my old Unity project but I've encountered several problems:
I'm able to do the training and generate .nn file, but whenever I put the file into the brain, it shows error message that says argumentexception off-axis dimensions must…

How Lemon
- 11
- 2
1
vote
1 answer
Curriculum learning in ML Agents - YAML configuration
I've set up a learning environment where a ball is to learn to go straight toward, and collide with, a target. The location of the target is randomised, but the radius of the target spawn point can be controlled by a public variable set in the…

generated_name
- 13
- 4
1
vote
0 answers
Is it possible to use a trained regression model of body tracking in unity?
I have trained a model using regression with TensorFlow to estimate the human pose, continuously.
Now, I am wondering if I can use this trained regression model in unity to track the human hands and body.
I see that Reinforcement learning models are…

tara
- 51
- 8
1
vote
1 answer
'UnityEnvironment' object has no attribute 'get_agent_groups' ( mlagents_envs 0.16.1 )
python version as
Python 3.6.10 :: Anaconda, Inc.
And was able to follow this docs successfully
But then i want to control environment with PYTHON-API so i followed this and with my code
from mlagents_envs.environment import…

Rajan Lagah
- 2,373
- 1
- 24
- 40
1
vote
1 answer
'UnityEnvironment' object has no attribute 'behavior_spec'
I followed this link to doc to create environment of my own.
But when i run this
from mlagents_envs.environment import UnityEnvironment
env = UnityEnvironment(file_name="v1-ball-cube-game.x86_64")
env.reset()
behavior_names =…

Rajan Lagah
- 2,373
- 1
- 24
- 40
1
vote
1 answer
Why Unity's ML-Agents are not working with Google Colab
I am trying to train ML-Agents on Google colab but every time it fails with the same given error.
WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow_core/python/compat/v2_compat.py:65: disable_resource_variables (from…

Rahul
- 47
- 8
1
vote
0 answers
Configurable normalization of game inputs for neural networks
I am building a small tool to train neural networks for Unity games using genetic algorithms.
I want my framework to be generic and usable with multiple games. One very important part regarding performance and training time is the normalization of…

Valentin Macé
- 1,150
- 1
- 10
- 25
1
vote
1 answer
ML-Agents agent not resetting?
I've been working on a pair of legs that self-balance. If his 'waist' goes below a certain y-position value (falling over/tripping), the area is supposed to reset and also deduct points from his reward-score. I'm awfully new to machine learning, so…

Jaden Williams
- 135
- 9
1
vote
2 answers
Mlagents-learn train: "The Unity environment took too long to respond."
I am trying to write my own game using ml-agents for AI and I obviously want to train it, but when I try to I see only this:
Error
I tried to run 3dBall example project and everything is running fine when I train it. I did everything according to…

newbie333
- 11
- 2
1
vote
1 answer
unity ML Agents and external data
Quite new to Unity, I'm more from a machine learning background. Planning to use ML Agents, and write some custom python / tensorflow scripts for it.
Is it possible to train based on data from my harddrive additionally to unity environment data? So…

SumakuTension
- 542
- 1
- 9
- 26
1
vote
0 answers
Can we use ML algorithms other than PPO in unity mlagents for multi agent like ddpg
I want to use multiple algorithms for a multi agent situation including PPO but I can't find any support for other algorithms like DDPG. If it's applicable how can I start working on it, what will be the procedure. How much changes do I have to make…

MUK
- 371
- 4
- 13
1
vote
1 answer
Unity machine learning using internal brain for pre-trained networks results in crash
I try to get the machine learning project of Unity running. The project can be found here: https://github.com/Unity-Technologies/ml-agents
Following all the necessary steps to set everything up, everything works fine until I try to use a pre-trained…

SapphireHD6970
- 51
- 4
1
vote
1 answer
Unity3D Machine Learning Setup for ML-Agents on Windows 10 with Tensorflow
I have been trying to get the Machine Learning Setup for ML-Agents for Unity 3D up and running for the past several hours, with no luck.
First I followed this video, which goes over the initial installations which are also outlined in this GitHub…

rrz0
- 2,182
- 5
- 30
- 65