Skip to content

Commit

Permalink
add CITATION file
Browse files Browse the repository at this point in the history
  • Loading branch information
yuchenlin committed Jul 19, 2024
1 parent 7d22a5e commit 28d49bc
Show file tree
Hide file tree
Showing 2 changed files with 9 additions and 1 deletion.
8 changes: 8 additions & 0 deletions CITATION.cff
Original file line number Diff line number Diff line change
@@ -0,0 +1,8 @@
cff-version: 1.2.0
message: "If you use this software, please cite it as below."
authors:
- family-names: "Lin"
given-names: "Bill Yuchen"
title: "ZeroEval: A Unified Framework for Evaluating Language Models"
date-released: 2024-07-18
url: "https://github.com/yuchenlin/ZeroEval"
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# ZeroEval: A simple unified framework for evaluating LLMs
# ZeroEval: A Unified Framework for Evaluating Language Models

ZeroEval is a simple unified framework for evaluating (large) language models on various tasks.
This repository aims to evaluate instruction-tuned LLMs for their zero-shot performance on various reasoning tasks such as MMLU and GSM. We evaluate LLMs with a unified setup by controlling the factors such as prompting, sampling, output parsing, etc. In ZeroEval, we perform **zero-shot** prompting, and instruct LM to output both reasoning and answer in a **json**-formatted output. We are actively adding new tasks. Contributions are welcome!
Expand Down

0 comments on commit 28d49bc

Please sign in to comment.