I see that I have to define players observations for using Qmix + LSTM as here https://github.com/ray-project/ray/issues/8407#issuecomment-627401186 or as in this example https://github.com/ray-project/ray/blob/master/rllib/examples/two_step_game.py#L81
However, I don't understand what I should put into ENV_STATE
.
Is this field for states that player may be in? Are there any restrictions for them? Are they connected with observations (the field that is near) in any way?