-
-
Notifications
You must be signed in to change notification settings - Fork 11.3k
Fix test named tool use #27458
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Fix test named tool use #27458
Conversation
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Code Review
This pull request aims to fix test_named_tool_use by making it more deterministic with temperature=0.0 and modifying a user prompt. While the intent is clear, there is a critical issue in the construction of the user prompt that will likely lead to test failures. A space is missing between two concatenated strings, which will create a malformed prompt for the model. My review provides a specific code suggestion to correct this.
tests/entrypoints/openai/test_completion_with_function_calling.py
Outdated
Show resolved
Hide resolved
tests/entrypoints/openai/test_completion_with_function_calling.py
Outdated
Show resolved
Hide resolved
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
f9e97c1 to
d1ee9b8
Compare
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
|
/cc @DarkLight1337 PTAL |
|
Thanks for fixing! |
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Purpose
fix test_named_tool_use
Test Plan
Test Result
Essential Elements of an Effective PR Description Checklist
supported_models.mdandexamplesfor a new model.