Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run all external #5785

Draft
wants to merge 7 commits into
base: master
Choose a base branch
from
Draft

Run all external #5785

wants to merge 7 commits into from

Conversation

judovana
Copy link
Contributor

@judovana judovana commented Dec 3, 2024

This is script designed to verify/test/fix all external tests on local-host. It is designed to help with: #5575 (comment)

It also includes results from the January run

Whether to integrate it at the end is disputable.

@judovana judovana marked this pull request as draft December 3, 2024 15:26
@judovana judovana force-pushed the runAllExternal branch 4 times, most recently from 1b0b47e to 22dd1d4 Compare December 9, 2024 09:59
Tuned default excludes

to excllude run wrapper and criu

Only resolve RESULTS_DIR if it already exists

Set absolute path to results dir after its creation

Enable skip of finished tests

Including variables and make call to main log

made non found nonfatal
@judovana
Copy link
Contributor Author

@adamfarley @sxa hi! Afaic this PR is not for merge, but I had finally composed the matrix of pass/fail for external tests:

https://github.com/judovana/aqa-tests/tree/runAllExternal/external#passfail-matrix-112025

I think I wills tart to fix it one by one... It will be very slow run :) Any other ideas what next? Maybe we should merge only the table? IDK....

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant