-
-
Notifications
You must be signed in to change notification settings - Fork 728
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
llms: implement StreamingReasoningFunc for reasoning models #1125
Conversation
7b808fd
to
dbc0d6d
Compare
fbb682b
to
b6ce64d
Compare
b6ce64d
to
78079b7
Compare
Thanks for your contribution! Can you follow on with an example please? |
Okay, the deepseek example has been reused. |
a6fce78
to
959619f
Compare
Wups I merged this prematurely. |
* feat: implement StreamingReasoningFunc for resoning models * Using deepseek example for streaming reasoning content
did you test this with OpenAI? From my testing they fail when the temperature parameter is not removed. See #1129 |
This is a merged PR, please open a new issue for discussion. |
PR Checklist
memory: add interfaces for X, Y
orutil: add whizzbang helpers
).Fixes #123
).golangci-lint
checks.