Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Benchmark: display SD in living benchmark #163

Open
slobentanzer opened this issue Jun 10, 2024 · 0 comments
Open

Benchmark: display SD in living benchmark #163

slobentanzer opened this issue Jun 10, 2024 · 0 comments

Comments

@slobentanzer
Copy link
Contributor

slobentanzer commented Jun 10, 2024

As per #147, we record single scores and can calculate the per-run and between-run variance. However, since the full benchmark has not been run with a significant amount of iterations, this currently carries no information. Once we have run enough iterations, we can display the variance in the living benchmark as well.

@slobentanzer slobentanzer added this to the Improve Benchmarking milestone Jun 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Ideas
Development

No branches or pull requests

1 participant