[Feature Request]: Structured output #1879
Description
Do you need to file an issue?
- I have searched the existing issues and this feature is not already filed.
- My model is hosted on OpenAI or Azure. If not, please look at the "model providers" issue and don't file a new one here.
- I believe this is a legitimate feature request, not just a question. If this is a question, please use the Discussions area.
Is your feature request related to a problem? Please describe.
The problem at least using local models is:
openai.BadRequestError: Error code: 400 - {'error': "'response_format.type' must be 'json_schema'"}
Describe the solution you'd like
I consider the implementation of structured output via pydantic and omitting examples in the prompts to be highly interesting and important. The result tends to be extremely superior.
More info:
https://openai.com/index/introducing-structured-outputs-in-the-api/
Additional context
No response