Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

please add model correlation heatmap #386

Closed
aplonska opened this issue Apr 26, 2021 · 6 comments
Closed

please add model correlation heatmap #386

aplonska opened this issue Apr 26, 2021 · 6 comments
Assignees
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Milestone

Comments

@aplonska
Copy link
Collaborator

No description provided.

@aplonska aplonska added enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed labels Apr 26, 2021
@aplonska aplonska added this to the 0.10.4 milestone Apr 26, 2021
@pplonski pplonski self-assigned this Apr 30, 2021
pplonski added a commit that referenced this issue Apr 30, 2021
@pplonski
Copy link
Contributor

Spearman correlation is computed between all trained models at the end of AutoML training. The example below:

image

For classification the correlation is computed based on proba values. For multiclass the average of correlation for each class is done.

@pplonski pplonski reopened this May 4, 2021
@pplonski
Copy link
Contributor

pplonski commented May 4, 2021

Please resize in the case of many models.

@pplonski
Copy link
Contributor

pplonski commented May 4, 2021

I added larger figure in the case of the many models:

image

@pplonski pplonski closed this as completed May 4, 2021
@Tonywhitemin
Copy link

Hi pplonski,
Good day! I am now study this heatmap but have some questions on it...
Could you please help?
If follow the above commend you said:
"For classification the correlation is computed based on proba values. For multiclass the average of correlation for each class is done."
Since this heatmap is bases on different models, may I know it used what parameters or value to do the correlation?
Could you tell me what is the mechanism of it?
Thanks!

@pplonski
Copy link
Contributor

pplonski commented Jun 1, 2022

The correlation is computed between each model's predictions and target. It is computed with scipy.stats.spearmanr.

@Tonywhitemin
Copy link

Thank you so much pplonski!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

3 participants