Questions tagged [sikuli]

Sikuli is a Java based automation tool available for Windows, macOS and Linux that automates tasks using screen visual inspection. Sikuli operates by matching previously taken screenshots and emulates user interactions by taking control of mouse and keyboard. The biggest Sikuli advantage is being available for both Desktop and Web Applications as it doesn't require any API.

Sikuli is a visual technology to automate and test graphical user interfaces (GUI) using images (screenshots).

Sikuli includes

  • Sikuli Script, a visual scripting API for Jython,
  • Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily.
  • Sikuli-API, a visual scripting API for Java

Sikuli Script automates anything you see on the screen without internal API's support. You can programmatically control a web page, a Windows/Linux/Mac OS X desktop application, or even an iphone or android application running in a simulator or via VNC.

Sikuli was developed at User Interface Design Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) and supported in part by the National Science Foundation under award number IIS-0447800 and by Quanta Computer as part of the TParty project. It is now maintained by the Sikuli Lab at the University of Colorado Boulder. Sikuli Script and Sikuli IDE are both released under the MIT License.

871 questions
0
votes
1 answer

Can Sikuli be used for moble web testing?

I know Sikuli is used for mobile apps testing, has anyone used it for mobile web testing with iOS Safari or Android Browser on mobile devices?
Sun shine
  • 1
  • 2
0
votes
2 answers

Can any tel me whether it is possible to call sikuli methods like(find(),click(),wait()) in ruby?

I am able to use sikuli methods in python. But no idea about using in ruby. My professor told me to use ruby instead of python. So, can someone could help me out with this. Small code snippet or steps would be appreciated. If I want to use below…
Yashwanth Nataraj
  • 183
  • 3
  • 5
  • 16
0
votes
1 answer

HTTP-browsing library with active feedback

I have a webpage with a Flash object on it. I want to be able to click multiple different buttons within in. Regarding this method I was wondering if there is any library (preferable Python/Perl/JAVA) that can actually stream a page-open session,…
user1467267
0
votes
2 answers

Testing Editor Scalability with SIKULI - typing naturally

I'm trying to speed up an editor for large fortran files, and trying to test my tweaks using Sikuli. The problem is that if I was to type in a file with 20,000 lines, the editor becomes unresponsive. But when I ask Sikuli to type into a 20,000 line…
0
votes
1 answer

Run Sikuli from button in Excel

I am new to VBA. In Excel sheet I have data. At the end of the every row I have an onclick button. My requirement is when I click on a button it has to run Sikuli from command prompt. Which command is used to open and run the command prompt in VBA?
pravallika
  • 67
  • 2
  • 12
0
votes
0 answers

How can I track the status of installation of an application using Sikuli

I am using Sikuli to automate the process of installing a downloaded application on the Mac. The installation includes an add-on that also gets installed. e.g. While installing Adobe Reader, McAfee Security Scan gets installed as an add-on: How…
user1648855
  • 41
  • 1
  • 9
0
votes
2 answers

Sikuli+Webdriver: getting error - x.png looks like a file, but can't be found on the disk. Assume it's text

I'm trying to use sikuli to verify if an image appears on the html page or not. Below is the code: public void verifyimage() { Screen s = new Screen(); WebDriver driver = new FirefoxDriver (); driver.get("http://testpage.com/"); …
JLau
  • 303
  • 2
  • 5
  • 21
0
votes
1 answer

How to use Java code and Sikuli to click menu items

I have an application where I need to be able to log out and the only way to do so is to click on the Log out option in the drop down menu however I am having a lot of problems. I have captured the screenshots using the Sikuli IDE and when I run my…
Ona_17
  • 35
  • 1
  • 8
0
votes
1 answer

How to use my own sikuli file in java application

I have sikuli file which defined some classes in it. What I want to do is to use these classes in my own java program. Any ideas on how to implement this?
xuqin1019
  • 202
  • 3
  • 12
0
votes
2 answers

java.lang.UnsatisfiedLinkError: /tmp/tmplib/libVisionProxy.so: /tmp/tmplib/libVisionProxy.so

I am running Testng with Sikuli script, it is working fine in Eclipse ide. In Eclipse IDE I am using Java 1.7.0 version. But when I created an Ant script it is throwing an exception. When I checked with ant -v Apache Ant version 1.7.1 compiled on…
sreekanth
  • 1,267
  • 2
  • 13
  • 21
0
votes
1 answer

unable to run scripts on simulator from cron tab

We are using sikuli tool for mobile automation on our MAC OSX 10.7.3 I have written a shell script to open simulator and to run scripts on simulator /Users/ezprintsqa/Downloads/FoneMonkey/bin/iphonesim launch …
Praveen
  • 53
  • 1
  • 1
  • 8
0
votes
1 answer

How do I successfully install sikuly on fedora 16?

I have a problem installing sikuli on fedora 16 its a 64 bits architecture, my main problem comes with the compilation of opencv, sikuli requires the 2.1 version of opencv and in the cmake step it tells me it can not find some libraries. I have…
0
votes
2 answers

Special characters in Sikuli script

I am trying to use some French special characters with Sikuli, when I type this in the Sikuli IDE, App.open('C:\\à table\\app.exe') But I get this error : [log] App.open C:\à table\NDC.exe(0) [error] App.open failed: C:\à table\NDC.exe not…
Michel Hua
  • 1,614
  • 2
  • 23
  • 44
0
votes
1 answer

Disregard right click and make it shift click instead

Is it possible to (in sikuli/java) to make a right click event form a shift click and disregard what would normally happen with the right click? Thanks, Odin
Odinulf
  • 571
  • 2
  • 7
  • 18
0
votes
1 answer

Firefox can't find Adobe reader when launched from TWIST/Eclipse

When I launch firefox from the command line, I am able to view PDF's in my browser. I am testing a GUI with Twist which is an IDE based on eclipse and using the sikuli driver. Before I run the test I close the browser. The line of code that opens…
Alessandro
  • 309
  • 5
  • 23