Code

Bugfix/llm as judge#41

Code

Merged

NISH1001 merged 2 commits intodevelopNASA-IMPACT/evalem:developfrom bugfix/llm-as-judgeNASA-IMPACT/evalem:bugfix/llm-as-judgeCopy head branch name to clipboardDec 16, 2024

+119-30

Commits

Commits on Dec 13, 2024

• Add max_n parameter to LLMasJudgeMetric to avoid large LLM calls for multi-prediction, multi-reference settings.

  Show description for 6498625
  NISH1001

  committed
  6498625

  Copy full SHA for 6498625

Commits on Dec 14, 2024

• Improve instance flattening based on robust checks on predictions and

  Show description for 897f061
  NISH1001

  committed
  897f061

  Copy full SHA for 897f061