I have a webpage with a Flash object on it. I want to be able to click multiple different buttons within in. Regarding this method I was wondering if there is any library (preferable Python/Perl/JAVA) that can actually stream a page-open session, emulate a resolution and perform (x,y) clicks.
For example (Python-like):
I Load the SomeUrlLib:
import SomeUrlLib
browser = new SomeUrlLib()
browser.setUrl('http://www.someaddress.com/subpage/')
browser.setResolution(1280, 800)
browser.startBrowsing('SessionName') # Bind a session name to this browsing session
locX = 40
locY = 80
browser.click(locX, locY, 'SessionName')
screen = browser.takeScreenshot('SessionName')
I'm thinking this is nearly impossible, as I can't imagine any library out there would be able to have Flash-engine build-in.
"If" this is possible in some weird way I would like to try to use the Sikuli API (screen recognition) to maybe react on screenshot feedback to click on certain coordinates, yet I guess dynamically changing pages are still an issue due to the latency the script would have towards what happens live in the page.