Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can I run AgentInstruct data on the AgentBench? #49

Open
harshraj172 opened this issue Dec 29, 2023 · 1 comment
Open

Can I run AgentInstruct data on the AgentBench? #49

harshraj172 opened this issue Dec 29, 2023 · 1 comment

Comments

@harshraj172
Copy link

harshraj172 commented Dec 29, 2023

Hey, thank you for your great work. I just wanted to know how can I run evaluation on the open source AgentInstruct data on the AgentBench repo. I will be really grateful if you can share the files defined here for running AgentInstruct on AgentBench. I am asking this because I want to see eval some models on the AgentInstruct data.

@lr-tsinghua11
Copy link
Contributor

Thank you for reaching out with your query.

  1. AgentInstruct is a curated dataset used to fine-tune the model; if you need to evaluate the model, you can refer to AgentLM, which is fine-tuned with this data, or you can choose the model fine-tuned by yourself.
  2. For the latest evaluation code, please visit AgentBench. You can configure the fine-tuned model for evaluation in the ./configs directory.
    If you have any more questions or need additional help, please don't hesitate to ask.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants