-
Notifications
You must be signed in to change notification settings - Fork 17.7k
openai[minor]: add image generation to responses api #31424
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Conversation
The latest updates on your projects. Learn more about Vercel for Git ↗︎ 1 Skipped Deployment
|
CodSpeed Walltime Performance ReportMerging #31424 will not alter performanceComparing
|
CodSpeed Instrumentation Performance ReportMerging #31424 will not alter performanceComparing Summary
|
@@ -118,6 +118,15 @@ | |||
|
|||
_FUNCTION_CALL_IDS_MAP_KEY = "__openai_function_call_ids__" | |||
|
|||
WellKnownTools = ( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
should we import this from core
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not at the moment. We should do something in the reverse direction likely -- core should not know anything specific about the responses API. We should resolve in a separate refactor to figure out how to decouple core completely from openai specifics.
|
||
if tool["type"] == "image_generation" and "partial_images" in tool: | ||
raise NotImplementedError( | ||
"Partial image generation is not yet supported via the LangChain ChatOpenAI client. " |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
mild preference for dropping partial_images
and emitting a warning.
alternatively, could update the error message here to make it very obvious what to do (drop partial_images
from the image_generation
tool definition)
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Updated the doc-string
Does not support partial images during generation at the moment. Before doing that I'd like to figure out how to specify the aggregation logic without requiring changes in core.