Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Outcome analysis: complain about repeated configuration name #9023

Open
gilles-peskine-arm opened this issue Apr 11, 2024 · 0 comments · May be fixed by #9286
Open

Outcome analysis: complain about repeated configuration name #9023

gilles-peskine-arm opened this issue Apr 11, 2024 · 0 comments · May be fixed by #9286
Labels
component-test Test framework and CI scripts enhancement size-s Estimated task size: small (~2d)

Comments

@gilles-peskine-arm
Copy link
Contributor

analyze_outcomes.py should complain if the same test run identification (platform, configuration, test suite, test case) appears more than once in outcomes.csv. That would likely be caused by having a test script that tests multiple configurations, but doesn't give them different configuration names (the default configuration name is the all.sh component name). This has happened, e.g. #7290.

@gilles-peskine-arm gilles-peskine-arm added enhancement size-s Estimated task size: small (~2d) component-test Test framework and CI scripts labels Apr 11, 2024
@gilles-peskine-arm gilles-peskine-arm linked a pull request Jun 18, 2024 that will close this issue
6 tasks
@minosgalanakis minosgalanakis moved this to Test cases not executed in Mbed TLS Epics Aug 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
component-test Test framework and CI scripts enhancement size-s Estimated task size: small (~2d)
Projects
Status: No status
Status: Test cases not executed
Development

Successfully merging a pull request may close this issue.

1 participant