Stack Overflow
Stack Overflow

Questions tagged [sikuli]

Sikuli is a Java based automation tool available for Windows, macOS and Linux that automates tasks using screen visual inspection. Sikuli operates by matching previously taken screenshots and emulates user interactions by taking control of mouse and keyboard. The biggest Sikuli advantage is being available for both Desktop and Web Applications as it doesn't require any API.

Sikuli is a visual technology to automate and test graphical user interfaces (GUI) using images (screenshots).

Sikuli includes

  • Sikuli Script, a visual scripting API for Jython,
  • Sikuli IDE, an integrated development environment for writing visual scripts with screenshots easily.
  • Sikuli-API, a visual scripting API for Java

Sikuli Script automates anything you see on the screen without internal API's support. You can programmatically control a web page, a Windows/Linux/Mac OS X desktop application, or even an iphone or android application running in a simulator or via VNC.

Sikuli was developed at User Interface Design Group, MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) and supported in part by the National Science Foundation under award number IIS-0447800 and by Quanta Computer as part of the TParty project. It is now maintained by the Sikuli Lab at the University of Colorado Boulder. Sikuli Script and Sikuli IDE are both released under the MIT License.

871 questions
0
votes
1 answer

How to export Sikuli scripts to java?

I am new to automation and have to use Sikuli, can you all tell me how to export Sikuli script in java also is it possible to integrate those scripts with Selenium.... Thanks in advance.....
user1315883
-1
votes
1 answer

strange behavior in using Images with transparency in Sikulix v2.0.5

I'm running Sikulix v2.0.5 on a linux machine (ubuntu 22.04 LTS). In order to ingnore background I try to use template images with transparent areas. But as soon as I use transparency Sikulix behave strage in finding the correct matches on screen.…
akazen
  • 1
  • 3
-1
votes
1 answer

Flash Application automation using Python and which tool

I have an application built on flash and that runs only on Internet Explorer. Sample screen of the application looks as shared. Also, I have shared object details. I want to know, Can I choose Python language + Any tool to automate. I have browsed …
Sitanshu Mohapatra
  • 11
-1
votes
1 answer

Robot-Sikuli script throwing exception error when run from jenkins

I am trying to run robot script with sikuli library and related code from jenkins. When run from terminal it works fine. But when run through jenkins it throws a exception as…
Sayali Waghmare
  • 102
  • 1
  • 1
  • 9
-1
votes
1 answer

Automatic clicking on java program buttons

So I need to automate some button clickings on a java program. I tried ahks/autoit's controlclick but it doesn't really work (normal clicks do work, but I require no mouse movement). I tried to get some information from window detective / window…
Gonzalo Tuñez
  • 65
  • 1
  • 9
-1
votes
1 answer

Sikuli keeps getting an error

Sorry im a total noob with this. So ive tried integrating Sikuli in my Working RF setup meaning, I have to move from Python to Jython for this to work. my problem now is that im always getting an error. Error in file…
jariusjames
  • 27
  • 1
  • 2
  • 7
-1
votes
1 answer

Sikuli Script image click with toggle

I am new to this so pardon my lack of knowledge. I am trying to write a script that constantly looks for images on the screen and clicks them when they appear. In addition, I was looking for the functionality to have the script be toggled on and off…
aroberts
  • 1
  • 1
-1
votes
1 answer

Sikuli - How to identify unique or random web elements

I have setup Sikuli with selenium and Java. I can click and navigate on screens. On my current screen, the element I want to identify changes each time I run the script)(You can basically see it as a random number). I want to identify the random…
Shaun Cromie
  • 339
  • 1
  • 3
  • 16
-1
votes
1 answer

How to randomly select an image using findall and clickall? Sikuli

The problem that I'm having is that when using "if image exists, then click image" the script wants to select the top image every time even if there are 8 others. How do I have it randomly select any of the images each time with equal…
Steve H
  • 83
  • 1
  • 7
-1
votes
2 answers

Sikuli without sacrificing mouse and keyboard

I am not very familiar with Sikuli. Can I use Sikuli with python 3.4 or only 2.7? In a Sikuli project, the script takes over the mouse and keyboard, meaning you can't work on something else while this is running. Obviously this is a big waste of…
Nadav
  • 1
  • 3
-1
votes
1 answer

Cannot find element from a jump out window. How can I switch to a new jump out window?

I'm trying to automate our system with Python2.7, Selenium-webdriver, and Sikuli. I have a problem on login. Every time I open our system, the first page is an empty page, and it will jump to another page automatically; the new page is the main…
Shi Tim
  • 423
  • 2
  • 5
  • 18
-1
votes
2 answers

sikuli+selenium+java : need to understand how sikuli works

I am new to sikuli.I need to understand how it works. I install sikuli and played little bit with IDE. However,I need to understand how can I make use of sikuli using java + selenium. In our application, we have high charts that we need to…
java user
  • 41
  • 5
-1
votes
1 answer

Sikuli not clicking on found image?

Here is what I have currently. public static void main(String[] args) throws FindFailed { Debug.setDebugLevel(3); Screen s = new Screen(); click(s.userCapture().getFile()); } private static void click(String image)…
k9b
  • 1,457
  • 4
  • 24
  • 54
-1
votes
3 answers

How to convert a multiline string into a list of lines?

In sikuli I've get a multiline string from clipboard like this... Names = App.getClipboard(); So Name = #corazona #Pebleo00 #cofriasd «paflio and I have use this regex to delete the first character if it is not in x00-x7f hex range or is not a…
litu16
  • 173
  • 5
  • 14
-1
votes
1 answer

Need help on Region based automation in sikuli

Can anyone help me on how to test using "Regions" in sikuli automation tool (i.e) how to use a region, where to use etc.. If there is tutorial (or) video link that would be gr8..if anybody has an webinar session that covers the entire programming…
user3836459
  • 43
  • 1
  • 6
1 2 3
…
58 59