Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Only add evaluation stats to the report once #86

Conversation

jeremyfowers
Copy link
Collaborator

Closes #81

all_evaluation_stats is a list that aggregates results across all caches, such that we can write them to the report CSV.

The implementation has a bug where we were adding all_evaluation_stats to report in the loop that traverses the caches, meaning results from cache N of T would be written to the CSV T-N times. Which would make the report insanely large if you have many caches.

Signed-off-by: Jeremy Fowers <jeremy.fowers@amd.com>
@jeremyfowers jeremyfowers force-pushed the 81-multi-cache-reporting-has-a-quadratic-number-of-rows-in-the-csv branch from 5ce4f78 to 9a3c566 Compare January 10, 2024 16:58
Copy link
Collaborator

@danielholanda danielholanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for fixing this!

src/turnkeyml/cli/report.py Show resolved Hide resolved
@jeremyfowers jeremyfowers merged commit b44bbfa into main Jan 10, 2024
10 checks passed
@jeremyfowers jeremyfowers deleted the 81-multi-cache-reporting-has-a-quadratic-number-of-rows-in-the-csv branch January 10, 2024 17:58
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Multi-cache reporting has a quadratic number of rows in the CSV
2 participants