Questions tagged [automated-tests]

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process (wikipedia.org).

As per wikipedia.org:

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process.

There are two general approaches to test automation:

Code-driven testing. The public (usually) interfaces to classes, modules or libraries are tested with a variety of input arguments to validate that the results that are returned are correct.

Graphical user interface testing. A testing framework generates user interface events such as keystrokes and mouse clicks, and observes the changes that result in the user interface, to validate that the observable behavior of the program is correct.

The principle of automated testing is that there is a program (which could be a job stream) that runs the program being tested, feeding it the proper input, and checking the output against the output that was expected. Once the test suite is written, no human intervention is needed, either to run the program or to look to see if it worked; the test suite does all that, and somehow indicates whether the program's output was as expected.

Test Automation also has dedicated section in Software QA & Testing community.

13134 questions
4
votes
1 answer

Mstest ParallelTestCount on Test classes not tests

I am running my unit tests ona test agent. I have changed my testsettings to use ParallelTestCount = "0" so the tests are run in parallel. I then have failing tests as the tests are using the same instance of a Mock. Is there anyway I can run each…
MicroMan
  • 1,988
  • 4
  • 32
  • 58
4
votes
1 answer

HTML annotation system to aid web UI test automation element/attribute references?

Is there a system for annotating HTML for the purpose of identifying elements/attributes critical to web user interface test automation (by Selenium, HTMLUnit, Watir, Sahi, etc.)? The system might be a standard or library. The annotations might for…
Will
  • 6,601
  • 3
  • 31
  • 42
4
votes
6 answers

Is there a right way to implement a continuous improvement (AKA software hardening) process?

Each release it seems that our customers find a few old issues with our software. It makes it look like every release has multiple bugs, when in reality our new code is generally solid. We have tried to implement some additional testing where we…
4
votes
2 answers

PHPUnit + Selenium 2: Action on ajax load

During test I need to do following: Click button which leads to ajax request and redirect after that Check that user has been redirected to correct page My…
Pavel
  • 3,967
  • 2
  • 29
  • 35
4
votes
1 answer

Android library assembles with Gradle but "package R does not exist" error raise on connectedCheck

I have an android library with the file structure below. Android_Library ├── libs └── src ├── instrumentTest │   ├── assets │   └── java └── main ├── aidl ├── gen ├── java └── res When I assemble the…
ZenBalance
  • 10,087
  • 14
  • 44
  • 44
4
votes
1 answer

Designing a CRUD test suite

I'm writing a suite of black-box automated tests for our application. I keep bumping into the same design problem, so I was wondering what people here think about it. Basically, it's a simple CRUD system. For argument's sake, let's see you're…
MathematicalOrchid
  • 61,854
  • 19
  • 123
  • 220
4
votes
5 answers

Starting external process during integration testing in maven

I want completely automated integration testing for a Maven project. The integration tests require that an external (platform-dependent) program is started before running. Ideally, the external program would be killed after the unit tests are…
flicken
  • 15,443
  • 4
  • 29
  • 29
4
votes
0 answers

PhantomJS.exe massive memory use with Webdriver

I have written a simple scraping program using PhantomJS and webdriver, which essentially consists of the following steps: Navigate to a page Collect a number of links (30) from the page by xpath For each link, navigate to that url and collect a…
chrisc
  • 434
  • 3
  • 9
4
votes
3 answers

Watin: Search in children of an element

I want to do a "two step" search using Watin. For example I would like to search for a ul-tag having class "abc". Then I would like to search for a certain li-tag inside that element. The code might look like this: ie.ElementWithTag("ul",…
Achim
  • 15,415
  • 15
  • 80
  • 144
4
votes
1 answer

Mocha.js tests bail(false) do not work for beforeEach

When I try to start my mocha test with bail(false) I need to not stop tests even if some beforeEach hook gives an error. But this doesn't help, did someobody coped with this earlier? Or.. is it possible?
Kosmetika
  • 20,774
  • 37
  • 108
  • 172
4
votes
1 answer

Selenium WebDriver and Junit Class design

I am fairly new to Selenium WebDriver and JUnit, I am testing a web app and was wondering is my class design correct in Junit for testing the UI? As I have seen instances of where people have used composition. Any advice would be greatly appreciated…
user1875703
  • 159
  • 2
  • 5
  • 14
4
votes
1 answer

Robot framework / selenium - possible to read javascript console?

When automating tests using the Robot framework, is it possible to read messages logged to the JS console via console.log? We are also using the selenium 2 library. We're using a third-party library that unfortunately does not provide events or…
Kir
  • 2,905
  • 2
  • 27
  • 44
4
votes
4 answers

What tool to test complex multi-processes system?

We have a data acquisition system made of many programs and scripts running together, some sequentially, most in parallel, on different machines. We use Jenkins to build and run unit tests. We now want to test the system as a whole by using a data…
Barth
  • 15,135
  • 20
  • 70
  • 105
4
votes
1 answer

How to integrate Grunt with Rails Asset Pipeline

The question is: how do you integrate Rails with Grunt? Just a quick brainstorm and I figured out that I need: PhanomJS Jasmine JSHint / JSLint I do not need or I don't know if I need (it's up to Rails) :) minification uglification…
wryrych
  • 1,765
  • 4
  • 20
  • 31
4
votes
1 answer

Visual Studio Web Test vs. Selenium

This can be a very opinionated question. Please keeps your posts factual. What are the pros and cons of using Microsoft Web Test in Visual Studio? Conversely, what are the pros and cons of Selenium?
SchwartzE
  • 2,558
  • 5
  • 30
  • 39