Computational framework for reinforcement learning in traffic control https://github.com/flow-project/flow
Questions tagged [flow-project]
98 questions
0
votes
1 answer
Problem about Get_state() function based in multi-agent
@Ashkan
I saw your answer on that problem (How to write Get_state() return based in multi-agent based on agent-id?)
You gave some example codes:
def get_state(self):
agent_state_dict = {}
i = 0
for intersection, edges in…
xiaoToby
- 1
- 2
0
votes
2 answers
Increasing lanes for Grid Scenario
I am trying to modify Grid Scenario template. When changing horizontal_lanes and vertical_lanes, the code is working without giving any problem.
The problem is that i could not place vehicles on other lanes. I've got different type of errors…
Ulas Bayram
- 1
- 1
- 1
0
votes
1 answer
Flow DepartLane definition exception
After running many episodes of the same environment, I often get this error telling me the departLane definition is invalid:
Error: Answered with error to command 0xc4: Invalid departLane
definition for vehicle 'host_0'; must be one of…
Gabizon
- 339
- 4
- 15
0
votes
1 answer
How is FLOW currently dealing with clipping actions, squash_to_range, no_final_linear
I am confused about the way FLOW is meant to make sure the policy network output is matched to the action space limits.
In the version of rllib/ray I installed following the installation guidelines, I see two different ways of dealing with this:
1)…
bmartin
- 15
- 3
0
votes
1 answer
how to use lane changing model SL2015 in flow?
When I try to run any scenario such as loop or highway using SL2015 as lane change model I get the following error: Error: value '0' must be greater than or equal to minExclusive facet value '0'
In file…
snageshrao
- 1
- 2
0
votes
1 answer
Problems about the MLP policy in FLOW
For the MLP policy for controlling the autonomous control, if we only use the current observations (speed of the autonomous vehicle, speed of the preceding vehicle and the relative distance) or we have to use some other processing method before…
Yue Wang
- 11
0
votes
1 answer
What's the meaning of "rl_actions" of flow/tutorials/tutorial09_environments.ipynb
When I am learning tutorial 9, I am confusing the rl_actions.
Because on the program, the rl_actions is not initialized and definition.
Why there is a 'rl_actions' parameter of the _apply_rl_actions function and compute_reward function?
I also check…
user11795736
- 69
- 5
0
votes
1 answer
How to use RL algorithm on flow?
I want to use RL algorithm to train my project. But I cannot find that on flow directory, how many types of algorithms I could use, and there are some explain document of these algorithms, or If I want to create a custom algorithm, how to do that?
user11795736
- 69
- 5
0
votes
1 answer
How to use /tools/randomTrips.py on ubuntu
My os system is 18.04. The sumo version is 1.2.0
I want to use the tool - randomTrip.
I input the command like that:
python ~/sumo/tools/randomTrips.py -n xxx.net.xml -r xxx.rou.xml -e 50 -l
But the error log is that:
File…
xiaoToby
- 1
- 2
0
votes
1 answer
Receiving error speed value (-1001) from Sumo
I am running the stabilizing_highway example from flow/examples/rllib.
I noticed that sometimes, during the state calculation in the merge environment:
for i, rl_id in enumerate(self.rl_veh):
this_speed =…
bmartin
- 15
- 3
0
votes
0 answers
How is the tutorial tutorial05_visualize.ipynb visualized?
When I run the tutorial05_iisuallize on jupyter notebook, there is no interface or output, but the code doesn't report errors, so I want to know what interface should appear if tutorial05_iisuallize runs successfully. Is it going to appear sumo-gui…
jing
- 11
0
votes
0 answers
On ubuntu, run "python randomTrips.py" -n xxx.net.xml -r xxxx.rou.xml -e 2000 -l" command, an error exist
My ubuntu system is 18.04.
Anaconda version:anaconda Command line client (version 1.7.2)
I can run "python randomTrips.py" command on my Windows,
Then I copy the randomTrip.py file into my ubuntu system,
And ran again, there is an error:
traceback…
xiaoToby
- 1
- 2
0
votes
1 answer
How to inspect the car number of individual intersection on a horizon time?
I am working with sumo&rllib, and I want to get the data(car number of an intersection) to let rllib agent to learn, how to inspect the number and how to import that data into rllib.
toby
- 21
- 7
0
votes
1 answer
Error when running tutorial01_sumo.ipynb in jupyter notebook
I'm following the flow/tutorials/README.md to set up the tutorial environment, but I still have some errors.
When I open the jupyter notebook interface, there are five environments in the 'kernel': python2, python[conda env:enter], python[conda…
jing
- 11
0
votes
1 answer
Error when running ''' examples/rllab/stabilizing_the_ring.py'''
when i run the following code,i met the problem, so can you give me some suggestion?
code:
'''(flow) sean@ubuntu:~/flow$ python examples/rllab/stabilizing_the_ring.py'''
output:
File…
jing
- 11