Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Starling-LM-7B-alpha, vicuna-13b-v1.5, vicuna-7b-v1.5 to AlpacaEval (config + outputs without annotations) #217

Merged
merged 3 commits into from
Jan 25, 2024

Conversation

gblazex
Copy link
Contributor

@gblazex gblazex commented Jan 25, 2024

shipping 3 more. generated by plain-old local hugging face decoding

might switch to vLLM or SGlang for future evals

@rtaori
Copy link
Collaborator

rtaori commented Jan 25, 2024

Do you have the evals results for the leaderboard?

@YannDubs
Copy link
Collaborator

YannDubs commented Jan 25, 2024

@rtaori: I'll do the eval, @gblazex wanted to run correlations between AE2 & ChatBot Arena. I agreed to use our new OAI credits for those evals if given the outputs.

@YannDubs YannDubs merged commit 340b6b0 into tatsu-lab:main Jan 25, 2024
2 checks passed
@gblazex
Copy link
Contributor Author

gblazex commented Jan 25, 2024

You guys are great, thank you for all the work!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants