Questions tagged [automated-tests]

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process (wikipedia.org).

As per wikipedia.org:

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process.

There are two general approaches to test automation:

Code-driven testing. The public (usually) interfaces to classes, modules or libraries are tested with a variety of input arguments to validate that the results that are returned are correct.

Graphical user interface testing. A testing framework generates user interface events such as keystrokes and mouse clicks, and observes the changes that result in the user interface, to validate that the observable behavior of the program is correct.

The principle of automated testing is that there is a program (which could be a job stream) that runs the program being tested, feeding it the proper input, and checking the output against the output that was expected. Once the test suite is written, no human intervention is needed, either to run the program or to look to see if it worked; the test suite does all that, and somehow indicates whether the program's output was as expected.

Test Automation also has dedicated section in Software QA & Testing community.

13134 questions
16
votes
4 answers

Cucumber tags for scenario outline examples

In the project I am currently working we are using cucumber for integration testing and to keep the regular daily builds from getting too big we use profiles using tags to have a smaller daily test and a larger weekly build test suite. Now I have a…
Martin Larsson
  • 1,008
  • 1
  • 8
  • 25
16
votes
3 answers

use expect to spawn command with arguments containing spaces

I want to use expect to run a simple command cat /tmp/id_rsa.pub over ssh. In a shell, I can run this wo problem, (with manually put in the password) ssh root@localhost 'cat /tmp/id_rsa.pub' I want to automate this with expect. My expect script…
Richard
  • 14,642
  • 18
  • 56
  • 77
16
votes
5 answers

How to run some but not all tests in a Perl test suite in parallel?

I've got a Perl-based test suite with 10,000+ tests that I would like to make run faster. I've tested using the -j flag to prove, and I have found that most-but-not-all of my tests are ready to run in parallel. While I can work on making the…
Mark Stosberg
  • 12,961
  • 6
  • 44
  • 49
15
votes
9 answers

How to perform regression tests in embedded systems

What good practices and strategies are there for running regression tests in embedded environments or in other situations where the possibility to automate tests is very limited. In my experience a lot of the testing has to be performed manually…
sris
  • 4,938
  • 27
  • 26
15
votes
3 answers

Squish alternative for Qt

I'm looking for an app that does something similar to Squish. I'd like it to be able to test Qt apps, maybe a free/open-source app, maybe with acces to the Qt API and a scripting language like Python for hand written test cases.
Paul
  • 20,883
  • 7
  • 57
  • 74
15
votes
3 answers

Is drag-and-drop possible in watir-webdriver?

I would like to drag-and-drop one element to the position of another, triggered from within a watir-webdriver script. By "drag-and-drop" I mean picking up a draggable element and releasing it on another. By "possible" I mean any method for drag/drop…
kinofrost
  • 768
  • 6
  • 16
15
votes
2 answers

A Test For HTTP 1.1 Compliance

I wonder if there is a piece of software to allow automatically testing a webserver for compliance with the HTTP protocol? Ideally I'd like this program to work like this: I give it the address and port, it runs a bunch of requests and then outputs…
user500944
15
votes
2 answers

Cypress - check if the file is downloaded

I have a little problem with trying to check if a file is downloaded. Button click generates a PDF file and starts its download. I need to check if it works. Can Cypress do this?
Dominik Skála
  • 793
  • 4
  • 12
  • 30
15
votes
2 answers

Property based testing in PHP?

In various more functional based languages there are tools (like Quickcheck) which allow for property based testing. How would I go about property based testing in PHP? I would like to be able to specify the in and output properties of a PHP method,…
Ward Bekker
  • 6,316
  • 9
  • 38
  • 61
15
votes
4 answers

Is it possible to use Espresso's IdlingResource to wait until a certain view appears?

In my test I have a stage where after pressing a button application does a lot of asynchronous calculations and requests to the cloud service, after which it displays a certain view. Is it possible to use Espresso's IdlingResource implementation to…
Rinat Veliakhmedov
  • 1,021
  • 1
  • 19
  • 36
15
votes
5 answers

selenium chrome driver select certificate popup confirmation not working

I am automating tests using selenium chromewebdriver 3.7. Whenever I lauch the site, I get a certificate selection popup like the one below However I am not able to click on the OK button. These are the options I have tried //I have tried…
user4237435
  • 333
  • 1
  • 2
  • 12
15
votes
4 answers

How to write a loop while in Robot Framework

I make my first simple test case, and I have one problem. Is it possible write a loop in Robot Framework? I want to retrieve the value from the address and the address of the modified variable "i". I want to perform until such an address exists,…
grandecalvo
  • 213
  • 1
  • 3
  • 10
15
votes
2 answers

Strategy for Automated UI testing on remote virtual machines

I'm using TeamCity for my CI builds, and I'd like to set up a second build for running automated UI tests on Windows XP and Windows 7 virtual machines. I imagine the build working as follows: Compile, run unit tests, etc. Prepare MSI using…
Paul Stovell
  • 32,377
  • 16
  • 80
  • 108
15
votes
1 answer

How to inspect argument to a gmock EXPECT_CALL()?

I'm using Google Mock (gMock) for the first time. Given the following code snippet: class LinkSignals { public: virtual ~LinkSignals() { } virtual void onLink(std::string) = 0; virtual void onUnLink() = 0; }; class…
Chimera
  • 5,884
  • 7
  • 49
  • 81
15
votes
7 answers

Language to learn to move out of manual testing towards automated/programming

I have been working as a manual tester and documentation (Test plans etc.) personnel in a company's software/IT division. I do not have a big programming background but I want learn programming language(s) and tool(s). Hence, I am looking for…
SKA
  • 153
  • 1
  • 2
  • 8