Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🌱 Split CI-Tests check into a raw and evaluation section #2291

Merged
merged 4 commits into from
Sep 29, 2022

Conversation

raghavkaul
Copy link
Contributor

What kind of change does this PR introduce?

Splits CI-Test checks into a Raw and Evaluation section. This will make it easier to implement scorecard-attestor.

What is the new behavior (if this is a feature change)?**

This change also fixes a bug where we previously overcounted CheckRuns and Statuses in repos with un-squashed PRs.

Special notes for your reviewer

Scores for GitHub repos that don't squash PRs will be more accurately counted for the CI-Tests check. This change removes behavior where we double counted CI Tests run on a single commit across all commits in a PR.

* Restructure data by grouping commits by Pull Request

Signed-off-by: Raghav Kaul <raghavkaul@google.com>
@codecov
Copy link

codecov bot commented Sep 22, 2022

Codecov Report

Merging #2291 (0568600) into main (347c2a8) will decrease coverage by 0.76%.
The diff coverage is 21.16%.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #2291      +/-   ##
==========================================
- Coverage   41.28%   40.51%   -0.77%     
==========================================
  Files         110      112       +2     
  Lines        8773     8818      +45     
==========================================
- Hits         3622     3573      -49     
- Misses       4885     4984      +99     
+ Partials      266      261       -5     

@raghavkaul raghavkaul temporarily deployed to integration-test September 22, 2022 17:44 Inactive
Signed-off-by: Raghav Kaul <raghavkaul@google.com>
@raghavkaul raghavkaul temporarily deployed to integration-test September 22, 2022 17:52 Inactive
@github-actions
Copy link

@github-actions
Copy link

Copy link
Contributor

@laurentsimon laurentsimon left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks. I got so confused with ci_tests not being a unit tests :D

@laurentsimon laurentsimon enabled auto-merge (squash) September 22, 2022 18:54
@raghavkaul raghavkaul temporarily deployed to integration-test September 28, 2022 21:16 Inactive
@github-actions
Copy link

@raghavkaul raghavkaul temporarily deployed to integration-test September 29, 2022 14:45 Inactive
@github-actions
Copy link

@laurentsimon laurentsimon merged commit 29893ae into ossf:main Sep 29, 2022
@raghavkaul raghavkaul deleted the split-citests-check-raweval branch September 29, 2022 19:46
raghavkaul added a commit to raghavkaul/scorecard that referenced this pull request Oct 21, 2022
* Split CI tests into a raw and evaluation section

* Restructure data by grouping commits by Pull Request

Signed-off-by: Raghav Kaul <raghavkaul@google.com>

* Fix linter & license

Signed-off-by: Raghav Kaul <raghavkaul@google.com>

Signed-off-by: Raghav Kaul <raghavkaul@google.com>
N8BWert pushed a commit to N8BWert/scorecard that referenced this pull request Nov 28, 2022
* Split CI tests into a raw and evaluation section

* Restructure data by grouping commits by Pull Request

Signed-off-by: Raghav Kaul <raghavkaul@google.com>

* Fix linter & license

Signed-off-by: Raghav Kaul <raghavkaul@google.com>

Signed-off-by: Raghav Kaul <raghavkaul@google.com>
Signed-off-by: nathaniel.wert <nathaniel.wert@kudelskisecurity.com>
N8BWert pushed a commit to N8BWert/scorecard that referenced this pull request Nov 28, 2022
* Split CI tests into a raw and evaluation section

* Restructure data by grouping commits by Pull Request

Signed-off-by: Raghav Kaul <raghavkaul@google.com>

* Fix linter & license

Signed-off-by: Raghav Kaul <raghavkaul@google.com>

Signed-off-by: Raghav Kaul <raghavkaul@google.com>
Signed-off-by: nathaniel.wert <nathaniel.wert@kudelskisecurity.com>
raghavkaul added a commit to raghavkaul/scorecard that referenced this pull request Feb 9, 2023
* Split CI tests into a raw and evaluation section

* Restructure data by grouping commits by Pull Request

Signed-off-by: Raghav Kaul <raghavkaul@google.com>

* Fix linter & license

Signed-off-by: Raghav Kaul <raghavkaul@google.com>

Signed-off-by: Raghav Kaul <raghavkaul@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants