Skip to content

v6

Compare
Choose a tag to compare
@SeanROlszewski SeanROlszewski released this 28 Jan 02:33
· 410 commits to master since this release

This release includes several updates that affect Muter's handling of build errors, run-time errors, and mutation scores.

Specifically:

  • Muter performs an initial test suite run which will prevent mutation testing if it fails. In previous versions, it would continue performing its tests even if it was unable to compile your application or test suite. This would produce meaningless results and waste time.
  • Muter is able to identify when a build error occurs as a result of a mutant it creates, and no longer treats a build error as a passing mutation test. This improves the signal of generated mutation scores.
  • Muter now identifies run-time errors that lead to a crash, and differentiates them from test failures.
  • Muter's mutation score calculations now include failing tests, run-time errors, and passing tests, but explicitly exclude any build errors.

Additionally, there's been an improvement to the messaging when Muter doesn't discover source files; it's output now includes some suggestions to help you troubleshoot.

And lastly, there are a few minor style and copy changes to the mutation scores to make them a little bit easier to read.