My goal here is to have at least a minimum of automation for a specific game application. I am basically trying to write an overlay app that performs touch events programmatically based on the current screen of this game.
My approach to the problem is:
a. Take a screenshoot of the screen every few seconds
b. Use image recognition on the screenshot for template matching
c. Perform touch event programmatically on the returned location of the template matching algorithm
d. Delete screenshot
e. Go to step a
I am not so sure taking screenshots every few seconds and doing template matching is the "best" approach though. Is there maybe any other way to avoid taking screenshots?
What do you think? Have any suggestions?