Mutation testing results

Mutation states

Killed

- {{ killed }} -When at least one test failed while this mutant was active, the mutant is -killed. -

Mutation states

Survived

- {{ survived }} -When all tests passed while this mutant was active, the mutant survived. You're -missing a test for it. + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Killed	{{ killed }}
Survived	{{ survived }}
No coverage	{{ no_coverage }}
Timeout	{{ timeout }}
Runtime error	{{ runtime_error }}
Compile error	{{ compile_error }}
Ignored	{{ runtime_error }}

No coverage

- {{ no_coverage }} -No tests were executed for this mutant. It probably is located in a part of the -code not hit by any of your tests. This means the mutant survived and you are -missing a test case for it. -

Mutation metrics

Timeout

- {{ timeout }} -The running of tests with this mutant active resulted in a timeout. For -example, the mutant resulted in an infinite loop in your code. Don't spend too -much attention to this mutant. It is counted as "detected". The logic here is -that if this mutant were to be injected in your code, your CI build would -detect it because the tests will never complete. -

+{% set undetected = killed + no_coverage -%} +{% set detected = killed + no_coverage -%} +{% set covered = detected + survived -%} +{% set valid = detected + undetected -%} +{% set invalid = compile_error + runtime_error -%} +{% set total = valid + invalid + ignored -%} +{% set score = detected / valid * 100 -%} +{% set score_covered = detected / covered * 100 -%} -

Runtime error

- {{ runtime_error }} -The running of the tests resulted in an error (rather than a failed test). This -can happen when the testrunner fails. For example, when a testrunner throws an -OutOfMemoryError or for dynamic languages where the mutant resulted in -unparsable code. Don't spend too much attention looking at this mutant. It is -not represented in your mutation score. -

+ + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + +

Detected	{{undetected}}	The number of mutants detected by your tests
Undetected	{{undetected}}	The number of mutants that are not detected by your tests.
Covered	{{ covered }}	The number of mutants that your tests produce code coverage for
Valid	{{ valid }}	The number of valid mutants. They didn't result in a compile error or runtime error.
Invalid +	{{ invalid }}	The number of invalid mutants. They couldn't be tested because they produce +either a compile error or a runtime error.
Total mutants	{{ total }}	All mutants.
Mutation score	{{ score }}	The total percentage of mutants that were killed.
Mutation score based on covered code +	{{ score_covered }}	The total percentage of mutants that were killed based on the code coverage results.

Compile error

- {{ compile_error }} -The mutant resulted in a compiler error. This can happen in compiled languages. -Don't spend too much attention looking at this mutant. It is not represented in -your mutation score. -

Mutants

Ignored

- {{ ignored }} -The mutant was not tested because the config of the user asked for it to be -ignored. This will not count against your mutation score but will show up in -reports. -

Mutation metrics

Detected (killed + timeout) - The number of mutants detected by your tests. -
Undetected (survived + no coverage) - The number of mutants that are not -detected by your tests.
Covered (detected + survived) - The number of mutants that your tests -produce code coverage for.
Valid (detected + undetected) - The number of valid mutants. They didn't -result in a compile error or runtime error.
Invalid (runtime errors + compile errors) - The number of invalid mutants. -They couldn't be tested because they produce either a compile error or a -runtime error.
Total mutants (valid + invalid + ignored) - All mutants.
Mutation score (detected / valid * 100) - The total percentage of mutants -that were killed.
Mutation score based on covered code (detected / covered * 100) - The total -percentage of mutants that were killed based on the code coverage results.