sotopia-lab
Want to Know How to Run Benchmark #163
-
|
The instruction in https://docs.sotopia.world/examples/benchmark just doesn't work. I have tried many ways but still cannot figure out how to run the benchmark for a model (e.g. gpt-3.5-turbo, having set openAI Key). |
Beta Was this translation helpful? Give feedback.
Replies: 2 comments
-
|
@ProKil , I believe there's an API update |
Beta Was this translation helpful? Give feedback.
-
|
@Xiaohongdian119 Sorry for the lack of documentation for our new benchmark tool. You can do |
Beta Was this translation helpful? Give feedback.
@Xiaohongdian119 Sorry for the lack of documentation for our new benchmark tool. You can do
sotopia benchmark --helpto view the usage for now. We are preparing a new version of doc to cover this.