-
Notifications
You must be signed in to change notification settings - Fork 497
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
🌱 Split CI-Tests check into a raw and evaluation section #2291
🌱 Split CI-Tests check into a raw and evaluation section #2291
Conversation
* Restructure data by grouping commits by Pull Request Signed-off-by: Raghav Kaul <raghavkaul@google.com>
Codecov Report
Additional details and impacted files@@ Coverage Diff @@
## main #2291 +/- ##
==========================================
- Coverage 41.28% 40.51% -0.77%
==========================================
Files 110 112 +2
Lines 8773 8818 +45
==========================================
- Hits 3622 3573 -49
- Misses 4885 4984 +99
+ Partials 266 261 -5 |
Signed-off-by: Raghav Kaul <raghavkaul@google.com>
a6703a6
to
2a384a9
Compare
Integration tests success for |
Integration tests success for |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks. I got so confused with ci_tests not being a unit tests :D
Integration tests success for |
Integration tests success for |
* Split CI tests into a raw and evaluation section * Restructure data by grouping commits by Pull Request Signed-off-by: Raghav Kaul <raghavkaul@google.com> * Fix linter & license Signed-off-by: Raghav Kaul <raghavkaul@google.com> Signed-off-by: Raghav Kaul <raghavkaul@google.com>
* Split CI tests into a raw and evaluation section * Restructure data by grouping commits by Pull Request Signed-off-by: Raghav Kaul <raghavkaul@google.com> * Fix linter & license Signed-off-by: Raghav Kaul <raghavkaul@google.com> Signed-off-by: Raghav Kaul <raghavkaul@google.com> Signed-off-by: nathaniel.wert <nathaniel.wert@kudelskisecurity.com>
* Split CI tests into a raw and evaluation section * Restructure data by grouping commits by Pull Request Signed-off-by: Raghav Kaul <raghavkaul@google.com> * Fix linter & license Signed-off-by: Raghav Kaul <raghavkaul@google.com> Signed-off-by: Raghav Kaul <raghavkaul@google.com> Signed-off-by: nathaniel.wert <nathaniel.wert@kudelskisecurity.com>
* Split CI tests into a raw and evaluation section * Restructure data by grouping commits by Pull Request Signed-off-by: Raghav Kaul <raghavkaul@google.com> * Fix linter & license Signed-off-by: Raghav Kaul <raghavkaul@google.com> Signed-off-by: Raghav Kaul <raghavkaul@google.com>
What kind of change does this PR introduce?
Splits CI-Test checks into a Raw and Evaluation section. This will make it easier to implement scorecard-attestor.
What is the new behavior (if this is a feature change)?**
This change also fixes a bug where we previously overcounted CheckRuns and Statuses in repos with un-squashed PRs.
Special notes for your reviewer
Scores for GitHub repos that don't squash PRs will be more accurately counted for the CI-Tests check. This change removes behavior where we double counted CI Tests run on a single commit across all commits in a PR.