Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Bugfix/llm as judge #41

Merged
merged 2 commits into from
Dec 16, 2024
Merged

Bugfix/llm as judge #41

merged 2 commits into from
Dec 16, 2024

Conversation

NISH1001
Copy link
Collaborator

Major Changes

  • Add max_n parameter to truncate total number of predictions per instance in multi-prediction instances for LLMAsJudgeMetric
  • Restructure of base classes to add _flatten_instances

Minor Changes

  • Add different method to check for different prediction/reference settings (single prediction single reference, multi-prediction single reference, etc.)

@NISH1001 NISH1001 merged commit 8993b4e into develop Dec 16, 2024
2 of 4 checks passed
@NISH1001 NISH1001 deleted the bugfix/llm-as-judge branch December 16, 2024 21:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant