TLDR: I want some way to read HDMI data directly in code, rather than output it to a monitor. Doesn't really matter what language.
Background: A friend of mine was curious about trying to write an AI for a video game we play, so we were discussing how to do it. At first he suggested to use a camera to read it and then feed that to the AI, but I was thinking there'd be less latency if you could just pull the visual data directly from the hdmi cable to use instead of adding another camera to the mix.
There seem to be some similar questions here, but all the one's I've found were unanswered.
After much google, I'm left with an unclear idea if it's even possible. There are some usb data analyzers, so if you could convert HDMI to USB, that's a possiblity. I'm just trying to figure out if
A) What I'm trying to do is possible.
B) What the best way to do it is.