Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[ISSUE #8544] Add a retry mechanism to the unit test pipeline #8545

Merged
merged 4 commits into from
Aug 16, 2024

Conversation

chi3316
Copy link
Contributor

@chi3316 chi3316 commented Aug 16, 2024

Which Issue(s) This PR Fixes

Fixes #8544

Brief Description

This pull request introduces a retry mechanism in the unit test pipeline to automatically retry failed unit tests up to two times.

Known Limitations

  • The retry mechanism relies on GitHub Actions with write permissions to trigger a new workflow run. As a result, only users with write access will be able to utilize the retry mechanism.This limitation is documented in the GitHub Actions documentation
  • Contributors without write permissions will not be able to trigger retries if their tests fail during a pull request. This could lead to cases where their pull requests require manual intervention from maintainers if a test fails due to intermittent issues.
  • To address this limitation, it is possible to modify the workflow permissions, such as by setting permissions.actions = write in the workflow file. However, this approach may introduce security risks by granting broader access than intended.

How Did You Test This Change?

  • Pipeline Simulation: The modified CI pipeline was run multiple times in a controlled environment to simulate various failure scenarios and confirm that the retry mechanism behaves as expected. The test workflow

@codecov-commenter
Copy link

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 46.97%. Comparing base (aa788e8) to head (33c126f).

Additional details and impacted files
@@              Coverage Diff              @@
##             develop    #8545      +/-   ##
=============================================
- Coverage      46.97%   46.97%   -0.01%     
+ Complexity     11334    11331       -3     
=============================================
  Files           1275     1275              
  Lines          89101    89101              
  Branches       11466    11466              
=============================================
- Hits           41857    41852       -5     
+ Misses         42068    42063       -5     
- Partials        5176     5186      +10     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@ShannonDing ShannonDing added the soc Summer of Code, hosted by Google, Alibaba, Chinese Academy of Sciences and so on label Aug 16, 2024
@ShannonDing
Copy link
Member

link #8262

@ShannonDing ShannonDing merged commit b512ba1 into apache:develop Aug 16, 2024
10 checks passed
@chi3316 chi3316 deleted the add-retry-mechanism branch August 29, 2024 13:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
soc Summer of Code, hosted by Google, Alibaba, Chinese Academy of Sciences and so on
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Enhancement] Add a retry mechanism to the unit test pipeline
3 participants