-
Notifications
You must be signed in to change notification settings - Fork 3.9k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🏗 Add new task gulp codecov-upload
to upload coverage reports
#22515
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I like the bug fixes! One thought though - I don't think uploading code coverage reports should be decoupled from generating these reports. Especially if it's only something that Travis does... it's more of a util function that immediately follows the report generation, not its own gulp task. What do you think?
Also, should I wait for this PR to merge before starting #22507?
Today, code coverage is generated and uploaded separately from two places: unit and integration tests. The server then merges the sources to generate a single report. This poses a problem when one of the two test runs fails, resulting in a noisy coverage chart for our repo. Decoupling uploading from generating solves this problem by making sure all sources have generated coverage data before uploading them once and for all.
It'll be slightly easier if this were to be merged first, but not a blocker. |
Codecov Report
@@ Coverage Diff @@
## master #22515 +/- ##
==========================================
- Coverage 85.61% 78.67% -6.95%
==========================================
Files 1556 794 -762
Lines 145994 49485 -96509
==========================================
- Hits 124987 38930 -86057
+ Misses 21007 10555 -10452
Continue to review full report at Codecov.
|
This is expected, since we were erroneously including ads, tests, and third party code in the coverage numbers. The new (more accurate) baseline coupled with status reports (that can be made to require a minimum patch-level coverage) will help us drive up this number. |
This PR does the following:
tasks/runtime-test
into a new taskgulp codecov-upload
Partial fix for #22507
Fixes #20480