Questions tagged [regression-testing]

Regression testing is a form of software testing that focuses on retesting past fixed bugs to verify that recent changes to the software have not reactivated the old bugs.

Regression testing is a form of software testing that focuses on retesting past fixed bugs to verify that recent changes to the software have not reactivated the old bugs. A software build in which old bugs resurface is said to have "regressed", in the sense that the software has taken a step backwards on the project completion timeline. Regression testing is typically done concurrently with unit testing, integration testing and systems testing and may be incorporated as a part of each of those testing phases.

223 questions
2
votes
1 answer

Function for out of sample testing a linear model

Can anyone recommend a function in R to me with which i can calculate the Out of Sample R-squared of a previously calculated linear model lm(). Regards and thanks in advance!
2
votes
0 answers

SVG comparison (regression testing)

I am searching for the most optimal way to compare svg files that come as an output of SpecFlow tests of the C# project I am working on. The goal is that after implemented functionality I can compare all files created before and after and pinpoint…
Mia
  • 143
  • 1
  • 9
2
votes
0 answers

PHP tool for comparing datasets in regression testing

I'm looking for a PHP library or process for comparing large hierarchical data sets and giving some form of human readable analysis. The purpose is for analyzing regressions in the process that created them. My current method of testing in PHPUnit…
RCeee
  • 21
  • 2
2
votes
1 answer

Continuous integration where should my automated tests be run from

I have a Bamboo server which is connected to source control system. If new code is added to the source control system a new build is triggered in Bamboo, the outcome of this build are two artifacts: "code.jar" "automated_test_scripts". Jar file gets…
JonB
  • 804
  • 3
  • 12
  • 40
2
votes
1 answer

Running tests in continuous integration vs. running them manually

Scenario 1: I've been playing around lately with a CI tool Jenkins, to integrate my Selenium WebDriver tests using Maven. I understand continuous integration (with respect to testing) is a concept where tests are triggered automatically, as soon as…
2
votes
2 answers

Optimizing Selenium tests by bypassing UI

Is there a way to bypass UI for those actions which need to be performed before and (or) after the test? Is it possible to send simple GET or POST requests to the same test session instead of writing the script in the test? For example, I want to…
2
votes
0 answers

CSS visual regression - do I need to store screenshots in git repository?

There is a technique to check if something visually not broken in HTML and CSS markup - visual regression testing. We do following steps: Check everything is ok. Create a test "reference" (creating *.png files). Change something. Run test and check…
2
votes
2 answers

Execute all tests in subdirs even if some fail

We have several regression tests in our piece of software taking advantage of the autotools (autoconf&automake) infrastructure. These regression tests are splitted among different subdirectories according to the functionalities/units they test. We…
Harald
  • 3,110
  • 1
  • 24
  • 35
2
votes
1 answer

CSS Regression testing with VCS and CI

BackstopJS generates a single page with regression test results. Is there any tool that works with CI (doesn't matter which one) and VCS (git) and assigns the test results to commits? I imagine the main page has a list of commits with passed/failed…
2
votes
2 answers

Svd recomposition with Mathnet numerics library seems wrong

I'm looking for non regression between Mathnet.Iridium and Mathnet.Numerics. Here is my code, using Mathnet.Numerics : double[][] symJaggedArray = new double[5][]; symJaggedArray[0] = new double[] { 3, 0, 0, 0, 0 }; symJaggedArray[1] = new double[]…
Fabrice E.
  • 413
  • 1
  • 4
  • 13
2
votes
0 answers

Build controller randomly gets unavailable, and has to be restarted manualy- TFS2010

Our problem is sometimes when we queue a new build with ours cuid tests the build controller gets "unavailable". Then we have to login on the build controller server and restart the service manualy in tfs Admin Console. This seems to happening…
2
votes
1 answer

How to setup an excel addin regression testing framework

I am writing some Excel addins at work in C++ in an XLL. Is there a standard and/or easy way to setup non regression tests for excel addins and integrate them with a source control software like SVN to produce automatic reports. As BonCodigo…
BlueTrin
  • 9,610
  • 12
  • 49
  • 78
2
votes
2 answers

What all modules or test cases need to be tested in Regression testing?

Few days back I went to an interview there they asked me What all modules you will test in Regression Testing? How you find out which test cases need to be executed in Regression testing?
Rasmi Ranjan Nayak
  • 11,510
  • 29
  • 82
  • 122
1
vote
3 answers

How to build dependent tests for regression testing

I have an ASP.Net MVC project and I thought I could use a tool like MS Test or NUnit to perform regression testing from the controller layer down to the database, however I hit an issue where tests are not designed to run in order (You can use…
ptutt
  • 1,338
  • 3
  • 18
  • 35
1
vote
1 answer

Regression testing when "test oracle" is an informal output comparison

I maintain a Python program that provides advice on certain topics. It does this by applying a complicated algorithm to the input data. The program code is regularly changed, both to resolve newly found bugs, and to modify the underlying…
max
  • 49,282
  • 56
  • 208
  • 355