Stack Overflow
Stack Overflow

Questions tagged [acceptance-testing]

Acceptance testing is a test conducted to determine if the requirements of a specification or contract are met

Acceptance testing is a term used in agile software development methodologies, particularly Extreme Programming, referring to the functional testing of a user story by the software development team during the implementation phase.

The customer specifies scenarios to test when a user story has been correctly implemented. A story can have one or many acceptance tests, whatever it takes to ensure the functionality works. Acceptance tests are black box system tests. Each acceptance test represents some expected result from the system. Customers are responsible for verifying the correctness of the acceptance tests and reviewing test scores to decide which failed tests are of highest priority. Acceptance tests are also used as regression tests prior to a production release. A user story is not considered complete until it has passed its acceptance tests. This means that new acceptance tests must be created for each iteration or the development team will report zero progress.

Source

591 questions
16
votes
6 answers

How detailed should a customer acceptance test be?

Here is a test description, testing the "Create New Widget" use-case. Confirm that you can enter a new widget into the system. Here is another test description, testing the "Create New Widget" use-case. Bring up the application. Create a new…
Andrew Shepherd
  • 44,254
  • 30
  • 139
  • 205
16
votes
3 answers

Must an actor of a user story be a human being?

User stories are traditionally written as expression "As a [User Type] I want [feature] so that [some benefit]". In the books and online resources [User Type] typically correspond to a role of a human being. However, when describing features of…
Vagif Abilov
  • 9,835
  • 8
  • 55
  • 100
16
votes
3 answers

How to organize the specs definition in Cucumber?

We are considering to use Cucumber on our project for acceptance testing. When we write a scenario in a Cucumber feature, we write a list of Given, When and Then statements. As we use cucumber-jvm project, the Given, When and Then statement are…
Romain Linsolas
  • 79,475
  • 49
  • 202
  • 273
16
votes
2 answers

What can cause MSIExec Error 1619 'This installation package could not be opened'

I'm attempting to automate a roundtrip install and uninstall of a set of MSI files (generated by WiX) from a pack of sample programs. For some reason, a .MSI file that's perfectly happy to install on a double click generates: This installation…
Ruben Bartelink
  • 59,778
  • 26
  • 187
  • 249
15
votes
1 answer

Error when trying to accept a native js popup with Codeception and Yii2

I'm trying to close a confirm js popup generated by Yii2 for confirmation of the deletion of the record, in this case a user, with Codeception and his. Below is the error: [WebDriverException] JSON decoding of remote response failed. Error code:…
VictorArcas
  • 630
  • 2
  • 7
  • 23
15
votes
1 answer

How to programmatically ignore some acceptance tests using TechTalk.SpecFlow and C#?

I have several feature files with some scenarios. I need to ignore several scenarios, or features, marked with some @tag depending on some condition. I have read specflow documentation but didn't find there something that can be useful for my…
Dmytro
  • 16,668
  • 27
  • 80
  • 130
14
votes
3 answers

Has anyone found a way to run C# Selenium RC tests in parallel?

Has anyone found a way to run Selenium RC / Selenium Grid tests, written in C# in parallel? I've currently got a sizable test suite written using Selenium RC's C# driver. Running the entire test suite takes a little over an hour to complete. I…
Peter Bernier
  • 8,038
  • 6
  • 38
  • 53
14
votes
1 answer

Running integration/acceptance tests on the frontend. Need an API for the frontend to tell Rails which database state to set up for each test

My frontend is an EmberJS-based app. It's totally async in nature, so testing it with Capybara is pain and misery. On the other hand, Ember provides a fantastic test suite out of the box which makes acceptance testing fun and effective. Normally,…
Andrey Mikhaylov - lolmaus
  • 23,107
  • 6
  • 84
  • 133
13
votes
3 answers

SpecFlow: Scenario Outline Examples

I just starting to work with SpecFlow and really like the tool. However I am running across some issues in relation to example data inputs into the Scenario Outlines. Just wondering if what I am facing is normal or whether there is a trick to it. I…
ccocker
  • 1,146
  • 5
  • 15
  • 39
11
votes
8 answers

How do I prevent Selenium RC from stealing window focus while my tests are running?

I know I'm probably in a small minority, but I have to use my machine at the same time my tests are running. The thing that always gets in my way is that the browser window is always stealing focus when I run test cases using Selenium RC. Which…
bakoyaro
  • 2,550
  • 3
  • 36
  • 63
11
votes
3 answers

System testing vs Acceptance testing - Difference in test cases

I'm a bit confused about the real difference between system testing and acceptance testing. When I search this topic the answers differ and I fail to see how the testcases can be vastly different. Facts I've discovered: System testing is conducted…
John Snow
  • 5,214
  • 4
  • 37
  • 44
9
votes
12 answers

Are unit tests and acceptance tests enough?

If I have unit tests for each class and/or member function and acceptance tests for every user story do I have enough tests to ensure the project functions as expected? For instance if I have unit tests and acceptance tests for a feature do I still…
Kenneth Cochran
  • 11,954
  • 3
  • 52
  • 117
9
votes
1 answer

Using SpecFlow for End-to-End Regression Testing

We are employing BDD and using SpecFlow to drive our development (ATDD). Our QA team would like to define their own 'end-to-end regression tests (in Gherkin/SpecFlow) and re-use the Steps we have already defined. (Please note - I know that this is…
Mark Chidlow
  • 1,432
  • 2
  • 24
  • 43
9
votes
1 answer

Codeception: how do I test file download?

I have a page with a several options and a button named "Download". How do I test that this button works - document begin downloading, using Codeception acceptance tests?
FelikZ
  • 2,976
  • 4
  • 32
  • 41
9
votes
3 answers

Testing without relying on implementation details

Imagine the following contrived example: public class LoginController { private readonly IValidate _validator; private readonly IAuthenticate _authenticator; public LoginController(IValidate validator, IAuthenticate authenticator) { …
kimsagro
  • 15,513
  • 17
  • 54
  • 69
1
2
3
…
39 40