I'm planning a new project tha would probably involve the manipulation of screen outputs on Linux systems. The idea is to use a camera to detect a person standing in front of a projector and remove that part of the image that would be projected onto the person. (So that at least the person is not blinded).
So basically, I need a man-in-the-middle attack for a secondary monitor. I found XvfB which (as far as I understand it) can simulate a screen. My idea is now to set up such a simulated screen, modify the content of the image and then send the new image to the real projector.
Has someone done something like this or has a completely different approach?