Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Break build on low test strength #128

Closed
hcoles opened this issue Jun 9, 2014 · 1 comment
Closed

Break build on low test strength #128

hcoles opened this issue Jun 9, 2014 · 1 comment

Comments

@hcoles
Copy link
Owner

hcoles commented Jun 9, 2014

By popular demand pitest makes it possible to break the build if a certain line coverage or mutation score is not achieved.

Using a metric in this way can however drive the wrong behaviors, resulting in over specified tests and unit tests for code that would be more sensibly integration tested rather than unit tested.

A better metric on which to break the build might be a measure of average test strength - the % of mutants that are executed by a test, but not killed by it.

This could be calculated from the number of killed mutants dived by the number of killed and surviving mutants (excluded those with a status of uncovered).

This ought to provide a metric that falls weak tests are introduced.

@maxgabut maxgabut changed the title Beak build on low test strength Break build on low test strength Jan 18, 2019
@hcoles
Copy link
Owner Author

hcoles commented Jun 24, 2020

Closed by #774

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant