New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

How to prompt for single answer without reference? #16

Open

andrewrreed opened this issue Dec 1, 2023 · 1 comment

andrewrreed commented Dec 1, 2023

What is the proper way to prompt JudgeLM for single answer + reference free evaluation?

The paper talks about this, but I don't see any explicit examples in the appendix nor in the hosted demo

deshwalmahesh commented Dec 25, 2023

You need to track the code files. Prompts are given here

then you can use this code to infer on you individual ones. I'm working on same so figured out how to refactor the code.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment