The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source Unity3D plugin that enables games and simulations to serve as environments for training intelligent agents. Agents - usually implemented as scripted C# Unity components - can be trained using reinforcement learning, imitation learning, neuroevolution, or other machine learning methods through a Python API.
Questions tagged [ml-agent]
103 questions
0
votes
1 answer
ML-AGENTS tensorflow model not running in inference mode
I am working on Ml-agents and training jet to fly towards target. Training is completed and now i am trying to run my model in inference mode.
getting this error.
ArgumentException: Off-axis dimensions must match Barracuda.TensorExtensions.Concat…
junaid raza
- 1
- 4
0
votes
2 answers
Unity ML-Agents Running Very Slowly
Using the Python API, whether I run using a build or in the Editor the simulation is much slower than when using the provided mlagents-learn methods. I'm running something similar to this, using a PyTorch implementation of DDPG and CUDA 9.0. Is this…
rafvasq
- 1,512
- 3
- 18
- 48
0
votes
1 answer
Unity - Running a Neural Network
I trained a model using PyTorch. In Unity, I am using a WebCamTexture to display a live video. How can I feed the webcam frames into the PyTorch model, then perform actions in Unity with the output of the model?
I found Unity ML-agents, but it…
AJ Z.
- 495
- 7
- 19
0
votes
1 answer
Training in Keras with external evaluation function
Let me first describe the setup:
We have an autonomous agent in Unity, whose decisions are based on the perceived environment(level) and some pre-defined parameters for value mapping. Our aim is to pre-train the agents' parameters in a DNN. So the…
00zetti
- 114
- 8
0
votes
1 answer
ValueError: List argument 'values' to 'ConcatV2' Op with length 0 shorter than minimum length 2 3Dball
Executing "3Dball" creates some errors in Unity ml-agent
When I execute PPO.ipynb, there is no error till "Load the environment".
Executing "Train the Agents" there are some errors
ValueError: List argument 'values' to 'ConcatV2' Op with length 0
…
deepsigner
- 33
- 1
- 6
0
votes
1 answer
Tensorflow and Cuda for Unity ML-Agents WITHOUT a GPU
I am trying to use tensorflow for use with unity ml-agents. I followed the setup instructions which can be found here as far as "creating the conda environment". I managed to run the conda create command succesfully, activate tensorflow, install…
0
votes
2 answers
Getting the dimensions of a numpy array right to plot converted greyscale image
as part of Unity's ML Agents images fed to a reinforcement learning agent can be converted to greyscale like so:
def _process_pixels(image_bytes=None, bw=False):
s = bytearray(image_bytes)
image = Image.open(io.BytesIO(s))
s =…
MarcoMeter
- 473
- 1
- 4
- 14
-1
votes
0 answers
Unity ml-agents problems adding another agent
I am brand new to unity and ml-agents and i am working on a project based on https://towardsdatascience.com/ultimate-volleyball-a-3d-volleyball-environment-built-using-unity-ml-agents-c9d3213f3064.…
Filip Byberg
- 1
- 1
-1
votes
0 answers
Getting "Invalid first argument to register()" from cattr package when trying to use ML-Agents
Whenever I try to access to the mlagents-learn --help this error shows up. How can I fix this? I'm doing it for Unity.
Traceback (most recent call last):
File "", line 198, in _run_module_as_main
File "", line 88, in…
Asd Fdh
- 1
- 1
-1
votes
2 answers
How do you use a variable declared inside a function in another function? (C#) UnassignedReferenceException: The variable inRay has not ben assigned
So i'm playing around in Unity MLAgents, and wanted to add the position off objects that a Raycast hits to the agent's observations.
This has really been an adventure for me as i don't know anything about Unity or C#, and i know this sounds easy…
LSX Y
- 3
- 3
-1
votes
1 answer
No matching distribution found for mlagents_envs
I was trying to install ml-agents into anaconda. I get following error on Anaconda Prompt:
ERROR: Could not find a version that satisfies the requirement mlagents_envs==0.15.0.dev0 (from mlagents==0.15.0.dev0) (from versions: 0.8.0, 0.8.1, 0.8.2,…
Ashutosh Verma
- 11
- 1
-1
votes
1 answer
ML-Agents AddVectorObs parameter question
I want observe bool value in AddVectorObs...
but i don't know how.
is there other function for observe bool values?
this is my values
public bool target1_eaten = false;
public bool target2_eaten = false;
public bool target3_eaten = false;
I want my…
AJAJ
- 1
- 1
- 4
-1
votes
1 answer
Agent dose not move with internal brain when build for ml-agent
The problem I have is that when I build my game with the brain set to "Internal" type and the graph model set, agent dose not move. But when I press the ▶️ button in Unity, agent moves.
I understand training method and I have graph model.
I want to…
miki kazuo
- 1
- 2