Skip to content

GNU/CI: use the aggregated-result.json files and move to python #7471

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 2 commits into from
Mar 19, 2025
Merged

GNU/CI: use the aggregated-result.json files and move to python #7471

merged 2 commits into from
Mar 19, 2025

Conversation

@sylvestre
Copy link
Contributor

@sylvestre sylvestre commented Mar 17, 2025

No description provided.

@github-actions
Copy link

github-actions bot commented Mar 17, 2025

GNU testsuite comparison:

Skip an intermittent issue tests/misc/stdbuf (fails in this run but passes in the 'main' branch)

@sylvestre
Copy link
Contributor Author

sylvestre commented Mar 17, 2025

I think it needs more work:

Warning: Skipping test comparison; no prior reference summary is available at 'reference/aggregated-result.json'.

@github-actions
Copy link

github-actions bot commented Mar 17, 2025

GNU testsuite comparison:

Skip an intermittent issue tests/misc/stdbuf (fails in this run but passes in the 'main' branch)

@github-actions
Copy link

github-actions bot commented Mar 18, 2025

GNU testsuite comparison:

Skip an intermittent issue tests/timeout/timeout (fails in this run but passes in the 'main' branch)

@github-actions
Copy link

github-actions bot commented Mar 18, 2025

GNU testsuite comparison:

Skipping an intermittent issue tests/misc/stdbuf (passes in this run but fails in the 'main' branch)

@sylvestre sylvestre force-pushed the selinux3 branch 2 times, most recently from a6bf62e to cc25ca9 Compare March 18, 2025 10:56
@github-actions
Copy link

github-actions bot commented Mar 18, 2025

GNU testsuite comparison:

Congrats! The gnu test timeout/timeout.log is no longer failing!

@sylvestre sylvestre marked this pull request as ready for review March 18, 2025 11:31
@sylvestre
Copy link
Contributor Author

sylvestre commented Mar 18, 2025

and it works:


FIXED TESTS:
Notice: Congrats! The gnu test timeout/timeout.log is no longer failing!
Loaded 5 tests to ignore from uutils/.github/workflows/ignore-intermittent.txt
Total tests in current run: 617
Total tests in reference: 617
New regressions: 0
Intermittent regressions: 0
Fixed tests: 1
Newly skipped tests: 0
Newly passing tests (previously skipped): 0
Notice: No new test failures detected

@sylvestre sylvestre requested a review from cakebaker March 18, 2025 13:25
cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
@github-actions
Copy link

github-actions bot commented Mar 18, 2025

GNU testsuite comparison:

Skipping an intermittent issue tests/timeout/timeout (passes in this run but fails in the 'main' branch)

cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
util/compare_test_results.py
Copy link
Contributor

@cakebaker cakebaker Mar 18, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Much easier to read than the bash code :)

Copy link
Contributor Author

@sylvestre sylvestre Mar 18, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

isn't it ? :)

@sylvestre @cakebaker
GNU/CI: use the aggregated-result.json files and move to python
5e1c5d8 
Co-authored-by: Daniel Hofstetter <daniel.hofstetter@42dh.com>
@sylvestre sylvestre requested a review from cakebaker March 18, 2025 16:27
@github-actions
Copy link

github-actions bot commented Mar 18, 2025

GNU testsuite comparison:

GNU test failed: timeout/timeout.log. timeout/timeout.log is passing on 'main'. Maybe you have to rebase?

cakebaker
cakebaker reviewed Mar 18, 2025
View reviewed changes
@sylvestre @cakebaker
simplify code
8e95af7 
Co-authored-by: Daniel Hofstetter <daniel.hofstetter@42dh.com>
@github-actions
Copy link

github-actions bot commented Mar 18, 2025

GNU testsuite comparison:

Congrats! The gnu test misc/stdbuf.log is no longer failing!
Congrats! The gnu test timeout/timeout.log is no longer failing!

@cakebaker cakebaker merged commit 38aee73 into uutils:main Mar 19, 2025
67 checks passed
@sylvestre sylvestre deleted the selinux3 branch March 19, 2025 08:53
sylvestre added a commit to sylvestre/coreutils that referenced this pull request Mar 23, 2025
@sylvestre @cakebaker
GNU/CI: use the aggregated-result.json files and move to python (uuti…
aecc8a9 
…ls#7471)

* GNU/CI: use the aggregated-result.json files and move to python

Co-authored-by: Daniel Hofstetter <daniel.hofstetter@42dh.com>

* simplify code

Co-authored-by: Daniel Hofstetter <daniel.hofstetter@42dh.com>

---------

Co-authored-by: Daniel Hofstetter <daniel.hofstetter@42dh.com>
@BrewTestBot BrewTestBot mentioned this pull request May 24, 2025
Merged
@moonfruit moonfruit mentioned this pull request May 26, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@cakebaker cakebaker cakebaker left review comments

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@sylvestre @cakebaker