-
Notifications
You must be signed in to change notification settings - Fork 753
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
This commit implements the F-beta score metric #1543
Merged
shahules786
merged 8 commits into
explodinggradients:main
from
Yuri-Albuquerque:feature/f-beta-score
Oct 25, 2024
Merged
This commit implements the F-beta score metric #1543
shahules786
merged 8 commits into
explodinggradients:main
from
Yuri-Albuquerque:feature/f-beta-score
Oct 25, 2024
Commits on Oct 20, 2024
-
This commit implements the F-beta score metric
for the AnswerCorrectness class.
Configuration menu - View commit details
-
Copy full SHA for e1f0ca8 - Browse repository at this point
Copy the full SHA e1f0ca8View commit details
Commits on Oct 21, 2024
-
also implements the F-beta score for
_factual_correctness, which is a weighted harmonic mean of precision and recall, where the recall is weighted by a factor of beta. The F-beta score is defined as: F-beta = (1 + beta^2) * (precision * recall) / (beta^2 * precision + recall) The F-beta score is a generalization of the F1 score, where beta = 1.0. The F1 score is the harmonic mean of precision and recall, and is defined as: F1 = 2 * (precision * recall) / (precision + recall)
Configuration menu - View commit details
-
Copy full SHA for 1c339e9 - Browse repository at this point
Copy the full SHA 1c339e9View commit details
Commits on Oct 22, 2024
-
returning to the original recall and precision
calculation in factual correctness and keeping the f1 score as f1-beta score as requested.
Configuration menu - View commit details
-
Copy full SHA for ed3b3f3 - Browse repository at this point
Copy the full SHA ed3b3f3View commit details
Commits on Oct 25, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 92166c0 - Browse repository at this point
Copy the full SHA 92166c0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 69cfa99 - Browse repository at this point
Copy the full SHA 69cfa99View commit details -
Configuration menu - View commit details
-
Copy full SHA for a0f6917 - Browse repository at this point
Copy the full SHA a0f6917View commit details -
Configuration menu - View commit details
-
Copy full SHA for c432b19 - Browse repository at this point
Copy the full SHA c432b19View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d5050c - Browse repository at this point
Copy the full SHA 8d5050cView commit details
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.