-
Notifications
You must be signed in to change notification settings - Fork 939
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[BFCL] Is this the same data used for the leaderboard? #546
Comments
Yes, they are the same. There is no blind/private dataset used for the current version of the leaderboard. |
@HuanzhiMao |
We are also considering setting the temperature to a lower value for reproducibility benefits. We would love to hear your opinions in #500! |
hello.
Thank you for making the BFCL public.
I have a question. Is the data in “Berkeley-Feature-Currency-Leaderboard/Data” the same data you used for the leaderboard (https://gorilla.cs.berkeley.edu/leaderboard.html)?
I'm curious if the data used for the leaderboard is blind data, different from github.
Thank you in advance for your response.
The text was updated successfully, but these errors were encountered: