Questions tagged [sikuli-x]

SikuliX is an automation tool which uses OpenCV image recognition to record and play user's actions.

SikuliX automates anything you see on the screen of your desktop computer running Windows, Mac or some Linux/Unix. It uses image recognition powered by OpenCV to identify and control GUI components. This is handy in cases when there is no easy access to a GUI's internals or the source code of the application or web page you want to act on.

SikuliX supports as scripting languages

  • Python language level 2.7 (supported by Jython)
  • Running RobotFramework text-scripts is supported
  • Ruby language level 1.9 and 2.0 (supported by JRuby)
  • JavaScript (supported by the Java Scripting Engine)

SikuliX comes with text recognition (OCR) and can be used to search for text. This feature is powered by Tess4J / Tesseract.

80 questions
0
votes
1 answer

how do i enter text in similar textboxs using sikuli

I am using sikuli and java for a citrix based webapplication. I am running in to multiple issues and not able to find documentation How do i enter text in similar textboxs in sikuli ? is there any option to choose textbox based on index ?
testerBDD
  • 255
  • 3
  • 18
0
votes
1 answer

Sikuli slash character not recognised (European keyboard)

I am using Sikuli and my script returns an error because of the following line. type("06/01/2017" + Key.ENTER) On the screen, I see that the script types 06 and then it stops. The problem is the slash. The error seems to be related to me using a…
vewees
  • 37
  • 6
0
votes
1 answer

Restart Sikuli script after error - calling from command line

If I run a script manually from the IDE and it errors out somewhere, I am able to just hit Run again and it continues from where it left off. If I call a script from command line, is there any way to do this? Running it from command line does not…
Alex
  • 69
  • 1
  • 5
0
votes
2 answers

how to click an image from the screen by using Sikuli with java when there are two exact identical images present in the screen

I have 2 exact same images (pattern, color, size ,everything is same) on the screen and in this case how do I click on Image 1? Whenever I am using the s.click() function, Sikuli tries to click on Image 1 some times and sometimes on Image 2. I have…
Nithya
  • 1
  • 2
0
votes
0 answers

How to click on last image match in Sikulix

I am automating a Java application using sikuli in our selenium automation project. In the Java application it displays a row of elements. Once I click the add button next to this row another row opens with the same fields. So now I have 2 rows with…
0
votes
2 answers

Why is the type() function not executed in this script?

I am new to Sikulix and I am running into a problem. I am trying to follow a tutorial, but the type() function does not seem to work. I am working on a windows 10 machine 64bit, with sikulix 1.1.3 IDE. Below is an image of my simple script in which…
Freeze
  • 237
  • 1
  • 5
  • 12
0
votes
1 answer

Using Sikuli Finder() to search screenshot with icon, providing cached like response when used in a loop

(Using Sikuli IDE -288 20/04/19 on Windows 10) I am currently having issues with a portion of code that runs correctly the first time around, but the second time where the function is looped instead of overwriting information created in the first…
0
votes
1 answer

sikulix api used in java code has error with opencv_java on linux

I wrote a java code to open an app and do some changes in it using sikulix api. The code works fine on windows but it gets this error on linux ubuntu: [error] RunTimeAPI: loadLib: opencv_java not usable: java.lang.UnsatisfiedLinkError: no…
MSH
  • 429
  • 3
  • 7
  • 20
0
votes
1 answer

Endless while loop and old removed code (popup)... well "popping up."

I'm struggling to troubleshoot a strange problem I've been having since starting to use Sikuli over multiple projects. I've been using the IDE and later tried to branch out due to having strange things happening with code. If I were to debug code…
0
votes
2 answers

What is the easiest way to change windows with Sikulix?

If I am within a GUI, interacting with said GUI using python 2.7 and sikulix API. If I click on something from within that GUI that opens another window in full screen, sikulix is currently having difficulty interacting with the newly opened window,…
Michael Smith
  • 494
  • 1
  • 5
  • 13
0
votes
1 answer

How to import cx_Oracle library into python SikuliX script

I'm trying to import cx_Oracle library into my Python test script inside sikulix, however I'm getting this error: [error] script [ connect_and_print ] stopped with error at line --unknown-- [error] Error caused by: Traceback (most recent call…
0
votes
1 answer

SikuliX IDE to use dotted characters

I use SikuliXIDE 1.1.4-SNAPSHOT with Ruby scripting and have strings, which contains following dotted characters: áéöüóőúű. I try to use paste() method to put it to a field. I found solution ALT key codes, but I don't know where these characters…
plaidshirt
  • 5,189
  • 19
  • 91
  • 181
0
votes
1 answer

RuntimeException: Sikulix fatal error: loadlib: opencv_java342.dll not in any libs folder

Project structure (full project can be downloaded here): Launcher.java class: import org.sikuli.script.Pattern; public class Launcher { public static void main(String[] args) { Pattern p1 = new…
Andrey Kotov
  • 1,344
  • 2
  • 14
  • 26
0
votes
1 answer

set proxy for firefox using sikuli in java

I'm new to sikuli and I want to run firefox and set proxy on it (through foxyproxy) using sikuli. This code opens firefox and load "https://google.com". How would I click on foxyproxy button in firefox toolbar and create new proxy using…
MSH
  • 429
  • 3
  • 7
  • 20
0
votes
1 answer

I have special characters in list and it breaks SikuliX

I try to get paths into list and everything is working just fine until I get special characters like ä or ö. In string they are represented as bytes for example ä is \xe4. If I use same Python script in Terminal I get all paths printed out correctly…
J. Rautava
  • 64
  • 1
  • 10