Questions tagged [sikuli]

Sikuli is a Java based automation tool available for Windows, macOS and Linux that automates tasks using screen visual inspection. Sikuli operates by matching previously taken screenshots and emulates user interactions by taking control of mouse and keyboard. The biggest Sikuli advantage is being available for both Desktop and Web Applications as it doesn't require any API.

Sikuli is a visual technology to automate and test graphical user interfaces (GUI) using images (screenshots).

Sikuli includes

  • Sikuli Script, a visual scripting API for Jython,
  • Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily.
  • Sikuli-API, a visual scripting API for Java

Sikuli Script automates anything you see on the screen without internal API's support. You can programmatically control a web page, a Windows/Linux/Mac OS X desktop application, or even an iphone or android application running in a simulator or via VNC.

Sikuli was developed at User Interface Design Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) and supported in part by the National Science Foundation under award number IIS-0447800 and by Quanta Computer as part of the TParty project. It is now maintained by the Sikuli Lab at the University of Colorado Boulder. Sikuli Script and Sikuli IDE are both released under the MIT License.

871 questions
6
votes
1 answer

using Python logger class to generate multiple logs for different log levels

I looked through the tutorials for the python logging class here and didnt see anything that would let me make multiple logs of different levels for the same output. In the end I would like to have three logs: _DEBUG.log (debug…
Snaxib
  • 1,620
  • 3
  • 14
  • 14
6
votes
1 answer

Paste command using Selenium

I'm using Python 2.7 and Selenium 2-44-0 on Windows 7. I'm looking for a quicker way of inputting text than using send_keys. Send_keys will print 1 letter at a time (which better imitates an actual user). I would like a way to print all of them…
user2869231
  • 1,431
  • 5
  • 24
  • 53
6
votes
4 answers

Sikuli List of Functions & Operators

I've just discovered Sikuli, and would like to see a comprehensive functions list without digging through the online-examples and demos. Has anyone found such a list? Furthermore, apparently Sikuli supports more complex loops and function calls as…
PPTim
  • 1,346
  • 6
  • 18
  • 33
6
votes
4 answers

Change Sikuli's sensitivity?

I've been using sikuli for awhile, however I have an issue with it... It's not sensitive enough. I'm trying to match something on the screen that is -EXACT-, and there are a few other items on the screen that look similar enough that sikuli is…
Jon
  • 305
  • 3
  • 20
  • 45
5
votes
1 answer

Sikuli actions inside a region

i am facing an issue while using sikuli through java, if there are 2 elements of same kind(or similar image) it fails to click on the correct element. so i wanted to know if it is possible to make sikuli just work inside a particular region and can…
Daniel Euchar
  • 1,740
  • 5
  • 28
  • 45
5
votes
3 answers

Drag and drop with Sikuli

I am having trouble using drag and drop with Sikuli. I would like to drag something in any other direction (up, down, left, right) for a fixed number of pixels. This looks like it should work: t = find("1325249963143.png") dragDrop(t, [t.x + 100,…
Željko Filipin
  • 56,372
  • 28
  • 94
  • 125
5
votes
1 answer

Sikulix/Jython UAC automation

I was wondering if anyone had any luck automating through UAC pop-ups during installer automation? I have an existing Automated installer code but it fails at the UAC area due to Sikuli not using keyboard/mouse during this step... Anyone had any…
user1304228
  • 189
  • 1
  • 4
  • 12
5
votes
2 answers

Spring boot forcing headless mode

I am trying to build a simple maven based app for automated testing using SikuliX. The app is currently created as a most recent spring-boot application (v. 1.4.1). The app itself is rather simple (POC at the moment), one class as an Application…
johnnnie
  • 71
  • 7
5
votes
0 answers

Is there any way to get Jython support in VIM / gVIM?

Does anybody know how to get Jython support in VIM / gVIM? (preferably on windows or alternatively on mac) By Jython support I mean code completion, syntax highlighting etc. especially when working with third party .jar files (e.g. sikulixapi.jar…
Wlad
  • 2,866
  • 3
  • 28
  • 42
5
votes
1 answer

Cannot use sleep(secs) in sikuli

So, I am new to sikuli coding, I do not have much experience with python either, so for many of you this might be a silly question. My problem is that I am trying to pause the program for x seconds. I have tried these 2 ways but every time I am…
Giannis An
  • 53
  • 1
  • 3
5
votes
2 answers

Why sometimes Python subprocess failed to get the correct exit code after running a process?

I am using Python subprocess to run external scripts on Windows 7. I am trying to get the exit code. In case 1, I run a python script test1.py. test1.py import sys sys.exit(24) <--exit code myscript1.py import subprocess process =…
userpal
  • 1,483
  • 2
  • 22
  • 38
5
votes
2 answers

How to see sikuli logs during execution?

I'm trying to output some debug info in a Sikuli script using print but I can see this info only after the script has finished execution because the IDE hides itself while the script is running. Is there a way to see those logs during execution?…
Poma
  • 8,174
  • 18
  • 82
  • 144
5
votes
4 answers

How can Sikuli be used to wait for a button for a long time, with perhaps some maintenance task in between?

I have a webpage where I am waiting for a button to appear, and when it appears I would like to click it. The button is on a timer and may take as long as an hour to appear. Also, if the button takes longer than a certain length of time to appear,…
sakatc
  • 309
  • 1
  • 2
  • 9
4
votes
1 answer

Sikuli - switching monitor and resolution invalidate the scripts

I do switch often between my laptop screen and my external 24 inch monitor, and I did notice that if I take snapshots on my laptop, then if I run the script while connected to the 24 inch monitor, the test does not work correctly anymore. Same if I…
user393267
4
votes
1 answer

Can't load JIntellitype while running SikuliX

I've been suffering with this issue all day long, I've tried looking for solutions throughout the webs, found some people that had the same issue but trying to solve the way they did, but it didn't work for me. Debug log: runsikulix.cmd -d 3 +++…
1
2
3
58 59