Questions tagged [ml-agent]

The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source Unity3D plugin that enables games and simulations to serve as environments for training intelligent agents. Agents - usually implemented as scripted C# Unity components - can be trained using reinforcement learning, imitation learning, neuroevolution, or other machine learning methods through a Python API.

103 questions
1
vote
0 answers

About Using Unity:ML-Agents and DQN Algorithm

I am having difficulty learning by connecting the external API and the unity environment I have created. I was looking at the previous ml-agent version of DQN code and wanted to use the following code. How should I use this in the current version? #…
1
vote
1 answer

Ml-agents cooperative push block not returning rewards

I'm working with the Cooperative push block environment ( https://github.com/Unity-Technologi...nvironment-Examples.md#cooperative-push-block) (exported in order to use the Python API) using the latest stable version. The issue is that I'm not…
1
vote
0 answers

Can't use trained model on older version of ML-agents from Unity

I'm training with my old Unity project but I've encountered several problems: I'm able to do the training and generate .nn file, but whenever I put the file into the brain, it shows error message that says argumentexception off-axis dimensions must…
1
vote
1 answer

Curriculum learning in ML Agents - YAML configuration

I've set up a learning environment where a ball is to learn to go straight toward, and collide with, a target. The location of the target is randomised, but the radius of the target spawn point can be controlled by a public variable set in the…
1
vote
0 answers

Is it possible to use a trained regression model of body tracking in unity?

I have trained a model using regression with TensorFlow to estimate the human pose, continuously. Now, I am wondering if I can use this trained regression model in unity to track the human hands and body. I see that Reinforcement learning models are…
tara
  • 51
  • 8
1
vote
1 answer

'UnityEnvironment' object has no attribute 'get_agent_groups' ( mlagents_envs 0.16.1 )

python version as Python 3.6.10 :: Anaconda, Inc. And was able to follow this docs successfully But then i want to control environment with PYTHON-API so i followed this and with my code from mlagents_envs.environment import…
1
vote
1 answer

'UnityEnvironment' object has no attribute 'behavior_spec'

I followed this link to doc to create environment of my own. But when i run this from mlagents_envs.environment import UnityEnvironment env = UnityEnvironment(file_name="v1-ball-cube-game.x86_64") env.reset() behavior_names =…
1
vote
1 answer

Why Unity's ML-Agents are not working with Google Colab

I am trying to train ML-Agents on Google colab but every time it fails with the same given error. WARNING:tensorflow:From /usr/local/lib/python3.6/dist-packages/tensorflow_core/python/compat/v2_compat.py:65: disable_resource_variables (from…
1
vote
0 answers

Configurable normalization of game inputs for neural networks

I am building a small tool to train neural networks for Unity games using genetic algorithms. I want my framework to be generic and usable with multiple games. One very important part regarding performance and training time is the normalization of…
Valentin Macé
  • 1,150
  • 1
  • 10
  • 25
1
vote
1 answer

ML-Agents agent not resetting?

I've been working on a pair of legs that self-balance. If his 'waist' goes below a certain y-position value (falling over/tripping), the area is supposed to reset and also deduct points from his reward-score. I'm awfully new to machine learning, so…
1
vote
2 answers

Mlagents-learn train: "The Unity environment took too long to respond."

I am trying to write my own game using ml-agents for AI and I obviously want to train it, but when I try to I see only this: Error I tried to run 3dBall example project and everything is running fine when I train it. I did everything according to…
1
vote
1 answer

unity ML Agents and external data

Quite new to Unity, I'm more from a machine learning background. Planning to use ML Agents, and write some custom python / tensorflow scripts for it. Is it possible to train based on data from my harddrive additionally to unity environment data? So…
SumakuTension
  • 542
  • 1
  • 9
  • 26
1
vote
0 answers

Can we use ML algorithms other than PPO in unity mlagents for multi agent like ddpg

I want to use multiple algorithms for a multi agent situation including PPO but I can't find any support for other algorithms like DDPG. If it's applicable how can I start working on it, what will be the procedure. How much changes do I have to make…
MUK
  • 371
  • 4
  • 13
1
vote
1 answer

Unity machine learning using internal brain for pre-trained networks results in crash

I try to get the machine learning project of Unity running. The project can be found here: https://github.com/Unity-Technologies/ml-agents Following all the necessary steps to set everything up, everything works fine until I try to use a pre-trained…
1
vote
1 answer

Unity3D Machine Learning Setup for ML-Agents on Windows 10 with Tensorflow

I have been trying to get the Machine Learning Setup for ML-Agents for Unity 3D up and running for the past several hours, with no luck. First I followed this video, which goes over the initial installations which are also outlined in this GitHub…
rrz0
  • 2,182
  • 5
  • 30
  • 65