-
Notifications
You must be signed in to change notification settings - Fork 402
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Breaking change in MeanAveragePrecision
by removing average
param
#2004
Comments
Hi! thanks for your contribution!, great first issue! |
Hi @Advitya17, thanks for raising this issue. |
torchmetrics==1.0.1, we had specified it in our code quite a few months back and were able to use torchmetrics until the breaking change happened. |
Then I do still not understand, because in v1.0.1 of torchmetrics torchmetrics/src/torchmetrics/detection/mean_ap.py Lines 241 to 250 in 035e433
|
@Advitya17 I can see that you have decided to remove the argument from your code. |
Yes if it can be included in a future release, that'll be very helpful, thank you very much! |
the arg |
🐛 Bug
We're using the
MeanAveragePrecision
method in the Responsible AI Toolbox repo for calculating Object Detection metrics, and realized that a breaking update in torchmetrics seems to remove theaverage
attribute.What would now be a way to specify a 'macro' or 'micro' averaging method for calculating the Object Detection metrics, and is that soon to be addressed in a next release?
To Reproduce
Steps to reproduce the behavior...
Code sample
https://github.com/microsoft/responsible-ai-toolbox/blob/main/responsibleai_vision/responsibleai_vision/rai_vision_insights/rai_vision_insights.py#L1110
Expected behavior
Environment
conda
,pip
, build from source):pip
1.13.1
, python 3.7-3.10Additional context
The
average
attribute has suddenly been removed from https://torchmetrics.readthedocs.io/en/stable/detection/mean_average_precision.html, though still exists for other image scenarios - https://torchmetrics.readthedocs.io/en/stable/classification/average_precision.htmlThe text was updated successfully, but these errors were encountered: