Questions tagged [automated-tests]

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process (wikipedia.org).

As per wikipedia.org:

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process.

There are two general approaches to test automation:

Code-driven testing. The public (usually) interfaces to classes, modules or libraries are tested with a variety of input arguments to validate that the results that are returned are correct.

Graphical user interface testing. A testing framework generates user interface events such as keystrokes and mouse clicks, and observes the changes that result in the user interface, to validate that the observable behavior of the program is correct.

The principle of automated testing is that there is a program (which could be a job stream) that runs the program being tested, feeding it the proper input, and checking the output against the output that was expected. Once the test suite is written, no human intervention is needed, either to run the program or to look to see if it worked; the test suite does all that, and somehow indicates whether the program's output was as expected.

Test Automation also has dedicated section in Software QA & Testing community.

13134 questions
19
votes
1 answer

Where is the output from an android instrumented test?

I managed to get gradle cC to work. My test just prints out and logs one line of text. grep -r text * fails. where is the system.out and logging output? thanks edit: i found the output for the unit tests (it's in .../app/build/test-results/). but…
Ray Tayek
  • 9,841
  • 8
  • 50
  • 90
19
votes
5 answers

Revert a Docker container back to its original image without restarting it?

Normally, people are all about making Docker persist data in their containers and there are about twenty million questions on how to do exactly that, but I'm a tester and I want to dump all that crap I just did to my data and revert to my known…
user2859458
  • 2,285
  • 1
  • 17
  • 27
19
votes
4 answers

Laravel framework classes not available in PHPUnit data provider

I have something like the following set up in Laravel: In /app/controllers/MyController.php: class MyController extends BaseController { const MAX_FILE_SIZE = 10000; // .... } In /app/tests/MyControllerTest.php: class MyControllerTest…
FixMaker
  • 3,759
  • 3
  • 26
  • 44
19
votes
4 answers

How to get Sikuli working in headless mode

If we have a headless test server running sikuli (both ubuntu and windows configurations needed), how to get it work without a physical monitor and preferably for as many screen resolutions as possible.
Amr Lotfy
  • 2,937
  • 5
  • 36
  • 56
19
votes
1 answer

Should I use browser or ptor = protractor.getInstance()?

I watched this video (https://www.youtube.com/watch?v=idb6hOxlyb8) which was uploaded Aug 2013. It claims that we should use ptor.get(url) rather than browser().navigateTo(url) in future. But when I look at docs on the protractor home page (on…
Tim Hong
  • 2,734
  • 20
  • 23
19
votes
9 answers

How to adopt TDD and ensure adherence?

I'm a senior engineer working in a team of four others on a home-grown content management application that drives a large US pro sports web site. We have embarked upon this project some two years ago and chose Java as our platform, though my…
Max A.
  • 4,842
  • 6
  • 29
  • 27
19
votes
5 answers

TestNG.xml suite to include all packages all files

Just about to implement a test framework with Maven+TestNG+Selenium. How do you declare a suite.xml that tells TestNG to run ALL tests? I've tried all these to no avail:
sibidiba
  • 6,270
  • 7
  • 40
  • 50
19
votes
6 answers

Automated testing of PhoneGap/Cordova apps

If I want to perform automated testing of a PhoneGap app (for now, only on iOS), what options do I have (if any)? Selenium would have been my first call, but Can you use Selenium with a phonegap application? suggests that's not possible. It looks…
tolien
  • 467
  • 2
  • 6
  • 15
18
votes
9 answers

How do I use Selenium in C#?

Selenium. I downloaded the C# client drivers and the IDE. I managed to record some tests and successfully ran them from the IDE. But now I want to do that using C#. I added all relevant DLL files (Firefox) to the project, but I don't have the…
Steve Marlusci
  • 225
  • 1
  • 2
  • 3
18
votes
1 answer

Testing Flutter apps with Cypress

Is it possible to test Flutter applications using the Cypress framework instead of using the built-in testing components that Flutter provides? If so, what are the pros & cons of both for Flutter testing if I know Cypress well?
Hazem Alabiad
  • 1,032
  • 1
  • 11
  • 24
18
votes
2 answers

Azure pipelines run specific task if and ONLY IF branch is equal to master in yaml

I am trying to change my yaml file to add some more tasks. This is my current yaml file: trigger: - master pool: vmImage: 'Ubuntu-16.04' steps: - task: Maven@3 inputs: mavenPomFile: 'pom.xml' # according to:…
Theodosis
  • 792
  • 2
  • 7
  • 22
18
votes
3 answers

Google Test - Using "SetUpTestSuite" doesn't seem to work

I'm trying to write a test suite that performs a test-suite level "Set Up" operation. I attempted to write a simple program first to try and get it working but I am not having any luck getting the "SetUpTestSuite" method to be called. #include…
tjwrona1992
  • 8,614
  • 8
  • 35
  • 98
18
votes
3 answers

Jest - import multiple tests in a describe block, reusing variables defined in beforeEach()

I am familiar with RSpec where it is very easy to reuse test cases by writing shared examples shared_example_for 'a cute pet' do it 'tests that the pet is a small' { expect(pet.size).to be_lesser_than(10) } it 'tests that the pet can smile' {…
Cyril Duchon-Doris
  • 12,964
  • 9
  • 77
  • 164
18
votes
2 answers

SpecFlow/Cucumber/Gherkin - Using tables in a scenario outline

Hopefully I can explain my issue clearly enough for others to understand, here we go, imagine I have the two following hypothetical scenarios: Scenario: Filter sweets by king size and nut content Given I am on the "Sweet/List" Page When I filter…
MattStacey
  • 875
  • 4
  • 12
  • 23
18
votes
4 answers

What's the best way to ocr as much text as possible from video game screenshots?

I'm trying to use the tesseract ocr tool to extract ocr text from video games(I'm pre processing screenshots and passing them to command line tool tsv output and parsing that). I'd like to use it for test automation not unlike selenium web testing.…
Roman A. Taycher
  • 18,619
  • 19
  • 86
  • 141