Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Docs: fix trainer metric definitions #1924

Merged
merged 3 commits into from
Mar 3, 2024

Conversation

adamjstewart
Copy link
Collaborator

Closes #1923

We are nowhere near the limit of how much detail we could have. We can always start adding mathematical equations.

Alternative: why don't we just list the metrics and link to the torchmetrics docs? If a metric isn't properly explained, we can always improve the torchmetrics docs.

@robmarkcole @jdilger

@adamjstewart adamjstewart added this to the 0.5.2 milestone Mar 3, 2024
@github-actions github-actions bot added the trainers PyTorch Lightning trainers label Mar 3, 2024
@robmarkcole
Copy link
Contributor

I think what should be listed here is perhaps a short description which is specifically summarising the meaning of the metrics in the imagery context - then users can lookup torch metrics for more specifics

@adamjstewart
Copy link
Collaborator Author

I'm just afraid that that short description will continue to blow up as people have questions unless we direct them to the torchmetrics docs for details.

@github-actions github-actions bot added the documentation Improvements or additions to documentation label Mar 3, 2024
@adamjstewart
Copy link
Collaborator Author

@robmarkcole better or worse? https://torchgeo--1924.org.readthedocs.build/en/1924/api/trainers.html

@robmarkcole
Copy link
Contributor

The docs rendering looks great, and the links to torchmetrics docs are a nice addition

@adamjstewart
Copy link
Collaborator Author

I did just notice we are not passing ignore_index to e.g. MulticlassFBetaScore

The only place we use MulticlassFBetaScore is ClassificationTask, which doesn't have an ignore_index parameter. So I'm confused...

@robmarkcole
Copy link
Contributor

I realised that and deleted comment after :)

@adamjstewart adamjstewart merged commit e40c78d into microsoft:main Mar 3, 2024
24 checks passed
@adamjstewart adamjstewart deleted the fixes/metrics branch March 3, 2024 18:45
isaaccorley pushed a commit that referenced this pull request Mar 3, 2024
* Docs: fix trainer metric definitions

* Link to torchmetrics docs

* Teach Sphinx where docs live
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation trainers PyTorch Lightning trainers
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Errors & improvements in Metrics descriptions
3 participants