Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Make it easier to access model evaluation results #178

Open
2 tasks
PGijsbers opened this issue Sep 20, 2022 · 0 comments
Open
2 tasks

Make it easier to access model evaluation results #178

PGijsbers opened this issue Sep 20, 2022 · 0 comments
Labels
feature Something new, expands what you can do with GAMA.
Milestone

Comments

@PGijsbers
Copy link
Member

Currently you can access them from evaluations.log or with gamaobject._evaluation_library.n_best(n, with_pipelines). The first is a little cumbersome if you still have access to the gama object, the second is unintuitive when you use BestFitProcessing as you then have to set with_pipelines=False explicitly. It would be great to have:

  • something like a gamaobject.leaderboard property which returns a dataframe with results of each evaluation
  • modify n_best behavior to return the best evaluation objects that are relevant to the initial configuration (if no pipelines are ever meant to be stored, the with_piplines=True default makes no sense)
@PGijsbers PGijsbers added the feature Something new, expands what you can do with GAMA. label Sep 20, 2022
@PGijsbers PGijsbers added this to the v22.1 milestone Sep 20, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature Something new, expands what you can do with GAMA.
Projects
None yet
Development

No branches or pull requests

1 participant