Questions tagged [automated-tests]

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process (wikipedia.org).

As per wikipedia.org:

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process.

There are two general approaches to test automation:

Code-driven testing. The public (usually) interfaces to classes, modules or libraries are tested with a variety of input arguments to validate that the results that are returned are correct.

Graphical user interface testing. A testing framework generates user interface events such as keystrokes and mouse clicks, and observes the changes that result in the user interface, to validate that the observable behavior of the program is correct.

The principle of automated testing is that there is a program (which could be a job stream) that runs the program being tested, feeding it the proper input, and checking the output against the output that was expected. Once the test suite is written, no human intervention is needed, either to run the program or to look to see if it worked; the test suite does all that, and somehow indicates whether the program's output was as expected.

Test Automation also has dedicated section in Software QA & Testing community.

13134 questions
21
votes
7 answers

In Selenium IDE, how to get the value of the base url

Is it possible to retrieve the value of the base url from inside a Selenium script (a plain HTML-saved script from Selenium IDE)? What I'm trying to do is verify the current url using assertLocation. But assertLocation returns the absolute url. I…
Emilien
  • 2,971
  • 2
  • 22
  • 32
20
votes
5 answers

Run Android instrumented tests fail

I tried to implement some unit and instrumented tests for my Android application (Java), my unit tests is working fine but instrumented tests are failing: @RunWith(AndroidJUnit4.class) @LargeTest public class ExampleInstrumentedTest { @Rule …
NizarETH
  • 969
  • 3
  • 15
  • 38
20
votes
2 answers

Proper way to automatically test performance in Python (for all developers)?

Our Python application (a cool web service) has a full suite of tests (unit tests, integration tests etc.) that all developers must run before committing code. I want to add some performance tests to the suite to make sure no one adds code that…
Tal Weiss
  • 8,889
  • 8
  • 54
  • 62
20
votes
3 answers

Getting a list of tests run with Jest (without running suites)

Is it possible to get a list of suites/specs without running the actual tests w/ Jest. For example, I have a test that looks like this: describe('when blah blah blah', function () { it('returns foobar', function () { /* test code */…
dev.kho
  • 219
  • 2
  • 6
20
votes
4 answers

Continue after failed assertion

Once an assertion fails( typically API response ), the remaining test steps in a test case do not get executed. How do I get SoapUI to continue on and complete the rest of the test steps? I am also looking for a way to retry that step again with the…
Sunilkumar V
  • 912
  • 2
  • 8
  • 28
20
votes
15 answers

Is unit testing a bad idea during beta/prototyping?

A new project we began introduced a lot of new technologies we weren't so familiar with, and an architecture that we don't have a lot of practice in. In other words, the interfaces and interactions between service classes etc of what we're building…
Gavin
  • 9,855
  • 7
  • 49
  • 61
20
votes
6 answers

Integrating Automated Web Testing Into Build Process

I'm looking for suggestions to improve the process of automating functional testing of a website. Here's what I've tried in the past. I used to have a test project using WATIN. You effectively write what look like "unit tests" and use WATIN to…
Haacked
  • 58,045
  • 14
  • 90
  • 114
19
votes
1 answer

Testing with probabilistic failure of components in Akka (Scala)

I've started using Akka with Scala to develop a set of interacting components in a bus-oriented architecture. I need to test the fault-tolerance of the system, and for that I was wondering if there is any way to use a probabilistic model of failure…
Hugo Sereno Ferreira
  • 8,600
  • 7
  • 46
  • 92
19
votes
4 answers

Automated web UI testing in Node.js

Are there any automated web testing libraries for Node.js, preferably headless?
Chris
  • 4,594
  • 4
  • 29
  • 39
19
votes
4 answers

How to measure screen render time in WPF

I am attempting to measure the performance for a WPF based application. Currently we have code that times how long it takes to add the content to the WPF render tree. At this point, control is returned to our program. The problem is that there is…
19
votes
12 answers

How can I simulate a disk full error in a Windows environment?

I have to write a bat script for a test scenario where the software that we are testing fails to write to file due to a disk full error. The test script must be automated, so that we can run it on overnight tests, for example. The test script must…
Alceu Costa
  • 9,733
  • 19
  • 65
  • 83
19
votes
3 answers

Is there a way to test AppSync code locally and/or in CI/CD?

I am looking to dive into a project using AppSync. So far I have been able to find plenty of articles and such online giving all the steps as to what buttons to click in order to get a sample project running, but none of them seem to touch on how…
19
votes
5 answers

IF ELSE in robot framework with variables assignment

I need to execute some keywords conditionally in robot framework, but I dont know how to do it, it does not work. I tried many options, but I guess I have the "IF-ELSE" statement completely wrong.. Choose Particular Filter ${FILTER} And Uncheck All…
neliCZka
  • 945
  • 1
  • 16
  • 27
19
votes
7 answers

Disable @Schedule on Spring Boot IntegrationTest

How can I disable the schedule auto-start on Spring Boot IntegrationTest? Thanks.
fassoline
  • 191
  • 1
  • 1
  • 6
19
votes
4 answers

Appium vs Espresso for automated testing framework

For last few weeks, I was using Appium(python) for android testing but yesterday we have decided to shift to Expresso(Java) for automated testing. There are couple of reasons why we are making this shift: We want to scale out our automated testing,…
python
  • 4,403
  • 13
  • 56
  • 103