-
-
Notifications
You must be signed in to change notification settings - Fork 587
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
test: calcuate test compatibility by test case #7158
Conversation
✅ Deploy Preview for rspack canceled.
|
Test Compatibility Diff
Unpassed tests4 🔴 Stats chunkGroups: TODO |
Summary
Use the estimated number of tests to calculate the webpack test coverage. The previous way of calculating test coverage has a significant error.
The old way is
TestCompatibility = TotalPassTests / TotalRunTests
. Cause the filtered test cases will not run, so we can not known that how many tests they have, thenTotalRunTests = TotalPassTests + FilteredCases
. But actually, each filtered test case may have more than one tests. So it should beTotalRunTests = TotalPassTests + (FilteredCases * TestsPerCaseAvg)
.This kind of calculation is more precise, but it also means a significant regression of the webpack test coverage.
And also, this pr enable all partial passed cases. Each of them will be equivalent to 0.5 passed case.
Checklist