Questions tagged [acceptance-testing]

Acceptance testing is a test conducted to determine if the requirements of a specification or contract are met

Acceptance testing is a term used in agile software development methodologies, particularly Extreme Programming, referring to the functional testing of a user story by the software development team during the implementation phase.

The customer specifies scenarios to test when a user story has been correctly implemented. A story can have one or many acceptance tests, whatever it takes to ensure the functionality works. Acceptance tests are black box system tests. Each acceptance test represents some expected result from the system. Customers are responsible for verifying the correctness of the acceptance tests and reviewing test scores to decide which failed tests are of highest priority. Acceptance tests are also used as regression tests prior to a production release. A user story is not considered complete until it has passed its acceptance tests. This means that new acceptance tests must be created for each iteration or the development team will report zero progress.

Source

591 questions
6
votes
2 answers

Are acceptance tests in Codeception supposed to run in testing environment? (Laravel4 + Codeception)

I am trying to run some acceptance tests in my Laravel application. While functional tests trigger testing environment, acceptance tests do not. Is it a bug or a feature of acceptance tests? The main problem why this is bothering me is the fact,…
HRcc
  • 81
  • 1
  • 3
6
votes
2 answers

How do you do TDD in Xcode?

Are there any good unit testing and acceptance testing frameworks that can be applied to XCode projects? I'm accustomed to doing TDD in Ruby and Python but am new to Objective-C and XCode.
Jim Jeffers
  • 17,572
  • 4
  • 41
  • 49
6
votes
2 answers

How to run tests after deployment using Maven?

I'm trying to decide how to create a set of Acceptance Tests for a Java-EE web application. Here's the setup: Maven is used to generate a WAR file and deploy it into Glassfish. On deployment, the MySQL database schema is automatically updated from…
Steve Chambers
  • 37,270
  • 24
  • 156
  • 208
6
votes
2 answers

Automated UI testing a large c# forms app

I am working on a fairly complicated project. We have a c# forms app that has several layers of business logic, communicating with a c++ hardware management layer via a socket interface. We have unit test coverage of the c++ side, and the business…
Brandon
  • 1,239
  • 9
  • 17
6
votes
2 answers

How do we handle minor permutations of BDD scenarios?

I'm loving the BDD approach to development, but I've bumped into a concern with how far to go. This comment from ThoughtWorks most recent Radar gives me pause: "The advent of behavior-driven design (BDD) testing frameworks like Cucumber, combined…
Ryan Nelson
  • 4,466
  • 5
  • 29
  • 45
5
votes
4 answers

Capybara-webkit raises Capybara::Driver::Webkit::WebkitInvalidResponseError

I got following message from webkit driver in my rspec: Capybara::Driver::Webkit::WebkitInvalidResponseError: Unable to load URL: http://127.0.0.1:44923/posts Few days ago it worked. The problem is with save_page method. What could be wrong?
Sławosz
  • 11,187
  • 15
  • 73
  • 106
5
votes
3 answers

Tool suggestions for specification by example where analysts - not developers - write the tests?

We are looking to initiate a bdd-style approach, inspired by Gojko Adzic's specification by example. Implementation is in java and devs are already writing junit tests. Key requirement is that specifications (acceptance tests) can be written, read…
sfinnie
  • 9,854
  • 1
  • 38
  • 44
5
votes
1 answer

Is there any difference between specflow's .msi installer and its nuget package?

On specflow's own instalation guide it says that the only way to install it is using the .msi installer and most of the tutorials I've read on the subject tell me to download and install said file but when I search on the nuget package manager I…
5
votes
2 answers

How to run tests in FitNesse/Slim headless?

we are considering to use FitNesse/Slim. But is there a way to start all written Tests without browsing the webpage and starting each manually ? It would be sufficient if there is a one-start-all kind of button somewhere to click. So either starting…
Emerson
  • 1,327
  • 2
  • 15
  • 24
5
votes
2 answers

Which tools are used to write acceptance tests for Python web applications (django)?

I've found only two: http://splinter.cobrateam.info/ http://lettuce.it/index.html I'd like to know you practices and experiences with these (or other) tools.
5
votes
1 answer

Get jacoco report from running acceptance test on real application

I'm new to sonar and jacoco and I wasn't able to find an ansewer to following question We are going to use sonar and jacoco to analyze our test coverage. We are going to have three kind of test: unit test, integration test (use spring boot test) and…
Evgen
  • 1,278
  • 3
  • 13
  • 25
5
votes
1 answer

What techniques are programmers using to write maintainable integration/functional/acceptance tests?

Integration/Functional/Acceptance tests are inherently difficult to maintain for a myriad of reasons: they take a long time to run, are hard to keep green consistently, can fail seemingly randomly, are cumbersome to debug, etc. etc. However, they…
5
votes
1 answer

How to only show failing tests from behave?

I've got a Python 3.4 project with tests built in the behave framework (version 1.2.5). When I run the tests, I get several hundred lines of output, most of it describing steps that passed with no problems. When a scenario fails, I need to scroll…
Alan
  • 192
  • 1
  • 8
5
votes
5 answers

What JavaScript UI testing framework should I use for a simple HTML5 + jQuery app?

I'm about to write a simple HTML5 + JavaScript (jQuery) app in my spare time in order to keep up with the latest web technologies (at work it's more advanced C# backend stuff). I'd like to develop in the same fashion that I've done for the last ten…
Martin R-L
  • 4,039
  • 3
  • 28
  • 28
5
votes
4 answers

Testing loss of internet connection during javascript execution

My problem I am looking to test how a script handles a loss of internet connection part way through execution. At a lower level I simply need to cause a number of network request to fail after certain point in the script. I am attempting to keep…