-
Notifications
You must be signed in to change notification settings - Fork 5
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Calculation of average precision #2
Comments
tshu-w
changed the title
Calculation of average accuracy
Calculation of average precision
Jan 22, 2023
Thank you so much for pointing it out. We directly use the evaluation metrics from the code in another paper which is a baseline method to compare with. We will add more clarification about it and allow users to customize the evaluation metrics when officially releasing this repo later. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
According to the definition of average precision from wikipedia or sklearn, AP computes the average value of p(r) over the interval from r=0 to r=1, i.e., the area under precision-recall curve.
However, the following code calculates the mean of precision directly, i.e., the area under p-k curve.
starmie/checkPrecisionRecall.py
Lines 90 to 94 in 00cae40
I believe that this may not affect the overall trend of the different methods and the contribution of this paper, just a friendly reminder :)
The text was updated successfully, but these errors were encountered: