Questions tagged [automated-tests]

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process (wikipedia.org).

As per wikipedia.org:

Test automation is the use of software to control the execution of tests, the comparison of actual outcomes to predicted outcomes, the setting up of test preconditions, and other test control and test reporting functions. Commonly, test automation involves automating a manual process already in place that uses a formalized testing process.

There are two general approaches to test automation:

Code-driven testing. The public (usually) interfaces to classes, modules or libraries are tested with a variety of input arguments to validate that the results that are returned are correct.

Graphical user interface testing. A testing framework generates user interface events such as keystrokes and mouse clicks, and observes the changes that result in the user interface, to validate that the observable behavior of the program is correct.

The principle of automated testing is that there is a program (which could be a job stream) that runs the program being tested, feeding it the proper input, and checking the output against the output that was expected. Once the test suite is written, no human intervention is needed, either to run the program or to look to see if it worked; the test suite does all that, and somehow indicates whether the program's output was as expected.

Test Automation also has dedicated section in Software QA & Testing community.

13134 questions
18
votes
7 answers

Test - FirebaseApp is not initialized in this process

I'm trying to run a test with Robolectric and it has an integration with Firebase. I have a project MyProject - Test that I'll be using to run the tests in a real instance of the database. The problem is that, when running cleanup before test, I…
18
votes
2 answers

iOS Automated Tests - XCTest vs Appium

I am looking for opinions from test engineers and iOS developers regarding a specific matter. I have been using Appium for over a year now, and I have come across various difficulties while running mobile web tests on real devices. Every time Apple…
John Smith
  • 353
  • 1
  • 4
  • 9
18
votes
4 answers

Qt automated testing

http://www.automatedqa.com/products/testcomplete/testing-qt-apps/ How would they have been able to do that? Is there a Qt inspection library? Standard window spy tools work in some areas, but other important areas (such as list items in a list…
Edward Strange
  • 40,307
  • 7
  • 73
  • 125
18
votes
7 answers

Manual testing Vs Automated testing

Testing can be mainly classified into manual and automated testing. With regard to this certain questions come to mind. They include: What is the basic difference between the two types of testing? What are the elements of challenges involved in…
boddhisattva
  • 6,908
  • 11
  • 48
  • 72
18
votes
7 answers

TestCase class not found by Android Studio

I have written a simple test case class and placed it in the default test directory for Android Studio: "src/androidTest". I've created an Android Tests build configuration that looks for all Tests in the module. When I run the build configuration,…
joates
  • 1,103
  • 2
  • 11
  • 22
18
votes
7 answers

image focus calculation

I'm trying to develop an image focusing algorithm for some test automation work. I've chosen to use AForge.net, since it seems like a nice mature .net friendly system. Unfortunately, I can't seem to find information on building autofocus algorithms…
Oren Mazor
  • 4,437
  • 2
  • 29
  • 28
17
votes
3 answers

Why does jest-dom give the error "TypeError: expect(...).not.toBeVisible is not a function" when I use it

In relation to a previous question - How can Enzyme check for component visibility? I tried using jest-dom to specifically use their toBeVisible function. Despite following the documentation I cannot get it to work in my test and get the…
Simon Long
  • 1,310
  • 4
  • 20
  • 39
17
votes
2 answers

Import project module in Cypress

I want to import some constants from my project into my tests (for instance to test localstorage operations). While using import (or require) from my IDE doesn't show errors: When running Cypress I get: Error: Cannot find module The module is in…
Nuthinking
  • 1,211
  • 2
  • 13
  • 32
17
votes
1 answer

How to automatically test Prometheus alerts?

We are about to setup Prometheus for monitoring and alerting for our cloud services including a continous integration & deployment pipeline for the Prometheus service and configuration like alerting rules / thresholds. For that I am thinking about 3…
17
votes
4 answers

Unable to create the tSQLtCLR assembly in SQL Server 2017

I recently installed SQL Server 2017 Express and localdb (general availablity). While attempting to install the tSQLt framework I've discovered a new security feature implemented in SQL Server 2017: the "clr strict security" option. This new…
Brent
  • 173
  • 1
  • 1
  • 5
17
votes
4 answers

Check if test failed in afterEach of Jest

When one of my Jest tests fails I want to store a screenshot, but only when it fails. Here is a piece of my test code as an example, the !passed part in the afterEach is not working. describe('Page', () => { it('should contain Text in the…
Niels van Reijmersdal
  • 2,038
  • 1
  • 20
  • 36
17
votes
7 answers

Understanding how software testing works and what to test

Intro: I've seen lots of topics here on SO about software testing and other terms I don't understand. Problem: As a beginner developer I, unfortunately, have no idea how software testing works, not even how to test a simple function. This is a…
RHaguiuda
  • 3,207
  • 9
  • 37
  • 55
17
votes
2 answers

How to modularize CasperJS test steps?

I am pretty new to CasperJS and I have started creating a test suite. Some of the steps (like logging in to the application) will be reused a lot, so we would like to manage them in library files (which are included in the test files). Plus, we…
eckhards
  • 171
  • 1
  • 3
17
votes
3 answers

Automated MSI installation

What is the best way to automatically install an MSI file or installer .exe? We want to do some automated testing from our build system on the installed copy of the product. Our installer has the usual license acceptance screen, install location,…
Luke Quinane
  • 16,447
  • 13
  • 69
  • 88
17
votes
3 answers

How to use SmallCheck in Haskell?

I am trying to use SmallCheck to test a Haskell program, but I cannot understand how to use the library to test my own data types. Apparently, I need to use the Test.SmallCheck.Series. However, I find the documentation for it extremely confusing. I…