Questions tagged [mutation-testing]

A method of software testing that involves modifying the source code or compiled intermediate code (Java: byte code, .NET: IL). Test suites that do not fail under each of these "mutations" is considered to be inadequate.

Mutation testing is a method of testing the adequacy of test suites. By applying mutations to the code under test, the effectiveness of a test suite can be judged. If the test suite fails under this mutation, it is effective against it.

Different mutation types are used: Ma, Offutt and Kwon describe intra-method, inter-method, intra-class and inter-class mutations. The simplest to implement is intra-method mutation, for which some of the mutations that may be used are:

  • Statement deletion.
  • Replace each boolean subexpression with true and false.
  • Replace each arithmetic operation with another one, e.g. + with *, - and /.
  • Replace each boolean relation with another one, e.g. > with >=, == and <=.
  • Replace each variable with another variable declared in the same scope (variable types should be the same). (source: Wikipedia)
191 questions
0
votes
0 answers

"Segmentation fault (core dumped)" in MILU, a mutation testing tool for c

To generate some great mutants of C programs, I cloned the Milu from GitHub, successfully compiled and run its example, just like the Compilation in Ubuntu and Example said. However, when I wanted to generate mutants of my c file, I process the c…
Tool Ply
  • 31
  • 4
0
votes
2 answers

Stryker mutation tesing with ES6 files

I have encountered an issue where I am trying to perform mutation testing on my util classes in my react project using this http://stryker-mutator.github.io/ library. However I get the following errors, [2017-05-17 16:29:04.321] [ERROR]…
Hasitha Shan
  • 2,900
  • 6
  • 42
  • 83
0
votes
1 answer

The Format of Mutation Generation of PIT Tool

I am interested in mutation testing and I want to generate faults in code with mutation testing tools and I found PIT. Besides I am reading a paper about regression testing and it gave the experimental data on its site. On of the data is the output…
0
votes
1 answer

Mutation Testing Tools for Visual Studio 2015

Is there any mutation testing tools from C# on visual studio 2015? Visual Mutator is not working with visual studio 2015 (link to github issue)
littleali
  • 408
  • 1
  • 6
  • 22
0
votes
0 answers

Mutation SURVIVED but runtime exception was thrown in the code under test

I have a Class calling a super-Method for registering a Bean Mapper. Other methods Use a super-Method for mapping Beans which relies on having the responsible Bean Mapper registered before. If a Bean is being mapped without a matching registered…
Olli
  • 689
  • 1
  • 6
  • 13
0
votes
2 answers

Why does JUnitCore only return the first results?

I am using JUnit 4 with Eclipse JDT to create automated Mutant testing. Here is the general overview of my code structure: //Basic for loop for(int i = 0; i < 10; i++) { //Read in source code from a Java file ...(works) //Change a line…
Zachary
  • 153
  • 1
  • 1
  • 7
0
votes
0 answers

Node.js: shutting down Karma server kills parent process

I'm involved in an OSS project that provides mutation testing for Javascript - basically testing unit test effectiveness by mutating the code that the unit test tests. An inevitable effect of mutating code is that you may run into endless…
-1
votes
2 answers

What is the competent programmer hypothesis in mutation testing?

While I am learning about mutation testing, I've read in Wikipedia: The first is the competent programmer hypothesis. This hypothesis states that most software faults introduced by experienced programmers are due to small syntactic errors. I…
Hamza Belmellouki
  • 2,516
  • 1
  • 18
  • 39
-1
votes
1 answer

Mutation Testing for Web Applications

I was wondering if there are any mutation testing tools for web applications. I understand there exist mutation analysis tools for specific server (PHP) and client side (JavaScript) languages to improve unit tests. But, are there any mutation…
-1
votes
1 answer

applications of mutation testing

what are different applications of mutation testing?
jas
  • 7
  • 1
-2
votes
1 answer

pieTest - Mutation Test failure

All, There is an issue while running mutation test cases. Getting the mutation test case failures as follows: removed call to java/util/List::sort → SURVIVED removed call to java/util/List::forEach → SURVIVED The code: List
RagaSGNur
  • 199
  • 1
  • 2
  • 15
1 2 3
12
13