Questions tagged [automated-tests]

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process (wikipedia.org).

As per wikipedia.org:

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process.

There are two general approaches to test automation:

Code-driven testing. The public (usually) interfaces to classes, modules or libraries are tested with a variety of input arguments to validate that the results that are returned are correct.

Graphical user interface testing. A testing framework generates user interface events such as keystrokes and mouse clicks, and observes the changes that result in the user interface, to validate that the observable behavior of the program is correct.

The principle of automated testing is that there is a program (which could be a job stream) that runs the program being tested, feeding it the proper input, and checking the output against the output that was expected. Once the test suite is written, no human intervention is needed, either to run the program or to look to see if it worked; the test suite does all that, and somehow indicates whether the program's output was as expected.

Test Automation also has dedicated section in Software QA & Testing community.

13134 questions
17
votes
4 answers

Automated input tool to for QA testing? Play back keystrokes and mouse clicks

Every time I test my program, I have to input a bunch of the same keystrokes and mouse clicks. I am looking for a tool to automate this keyboard and mouse input. Similar to a macro recorder. The tool needs to save the clicks and keystrokes I…
Tony_Henrich
  • 42,411
  • 75
  • 239
  • 374
16
votes
5 answers

Selenium Critique

I just wanted some opinions from people that have run Selenium (http://selenium.openqa.org) I have had a lot of experience with WaTiN and even wrote a recording suite for it. I had it producing some well-structured code but being only maintained by…
Adam Driscoll
  • 9,395
  • 9
  • 61
  • 104
16
votes
6 answers

How to stress test simulating heavy load using Selenium

I have a system to test, which is a video ads distribution technology. I need to load every video like 1-2 mins to serve the ads. The videos are played in a Flash client and streamed as FLV streams like in YouTube. The reason why I need to test it…
Sumit Ghosh
  • 3,264
  • 4
  • 40
  • 59
16
votes
1 answer

Best Resources for UIAutomation Testing for iOS Applications

Testing with UIAutomation on Instruments is great, however, the documentation and resources around it are either non-existent or in hiding. What are the best resources (documentation, blog posts, Stack Overflow questions) that have helped you in…
dtuckernet
  • 7,817
  • 5
  • 39
  • 54
16
votes
2 answers

Camera Module Focus Adjust using Contrast Transfer Function

Currently I'm designing a test program for mobile phone camera module. I'm trying to control a precision motor that adjust the focus barrel of the camera to get optimum focus point. I've been looking for an algorithm for contrast transfer function…
16
votes
1 answer

assert true vs assert is not None

I am working on some automated tests with a colleague and we wondered whether there were any differences in our approaches. We have a method that returns a HTTP response object. Occasionally, it might return None, but normally an object. The…
Craig Brett
  • 2,295
  • 1
  • 22
  • 27
16
votes
2 answers

Nightly Builds vs. Continuous Integration: Long-Running Automated Tests

We have the "problem" of a large automated suite of integration tests. While our build times are reasonable (< 1 hour), the tests typically take > 6 hours to complete. While it's great to have this large chunk of functionality tested in our build…
16
votes
4 answers

API Testing In Golang

I know that Golang has a testing package that allows for running unit tests. This seems to work well for internally calling Golang functions for unit tests but it seems that some people were trying to adapt it for API testing as well. Given to the…
Spikey
  • 435
  • 2
  • 5
  • 9
16
votes
2 answers

How to fix error "Could not detect Mac OS X Version from sw_vers output: '10.12 '" from Appium

I installed appium-1.5.3.dmg But when I click the stethoscope button the Appium is show error : ✔ Xcode is installed at: /Library/Developer/CommandLineTools [Error: Could not detect Mac OS X Version from sw_vers output: '10.12 '] Thank you!
Chattip Soontaku
  • 560
  • 1
  • 6
  • 17
16
votes
4 answers

VS 2013 MSTest vs nUnit vs xUnit

I realize there have been a LOT of questions on this topic but somehow I haven't found one that addressed my needs. My team is looking to start automated Unit testing our application. We have never done it before and nobody on the team has much…
Nakul Shukla
  • 173
  • 1
  • 1
  • 6
16
votes
4 answers

Testing ViewPager with multiple fragments using android espresso

I am trying to test my app which uses ViewPager. Each page contains fragments but these fragments are not always visible. I want to check visibility of a fragment in the currently visible page. onView(withId(R.id.container_weather)) …
Ubaier Bhat
  • 854
  • 13
  • 33
16
votes
2 answers

Simulate mouse movement in Ubuntu

Problem Am looking to automatically move the mouse cursor and simulate mouse button clicks from the command-line using an external script. Am not looking to: Record mouse movement and playback (e.g., xnee, xmacro) Instantly move the mouse from one…
Dave Jarvis
  • 30,436
  • 41
  • 178
  • 315
16
votes
3 answers

Good automated system testing framework in python

I am looking for good End to End testing framework under python, where the tests can be written in python and managed in a comfortable way. I know there are many unit testing frameworks, but I am looking for bigger scope, something like test…
GabiMe
  • 18,105
  • 28
  • 76
  • 113
16
votes
5 answers

How to run a single cucumber scenario in Intellij?

I have a simple problem - I want to run a single Cucumber scenario, but I can't seem to find any option/configuration for that. I have 5-6 scenarios and I can set up configurations to run all tests, but It takes too much time, when I am correcting…
user3651806
  • 161
  • 1
  • 1
  • 3
16
votes
5 answers

Zero-configuration, automated, random testing tools for web-apps?

In short, I'm looking for a tool to perform an automated, zero-configuration, full-frontal assault on a web application. I'm thinking this would logically be a browser-extension that both crawls links on a given domain/path, AND randomly inputs data…
Dolph
  • 49,714
  • 13
  • 63
  • 88