-
Notifications
You must be signed in to change notification settings - Fork 1.2k
docs: Document known limitations of Responses #3776
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: main
Are you sure you want to change the base?
Conversation
@jwm4 would we consider prompt-caching a limitation in the API: https://platform.openai.com/docs/api-reference/responses/create#responses-create-prompt_cache_key Allowing consumers the ability to configure this will matter from a cost/efficiency standpoint (especially with the open implementation here). |
c753bb9
to
7fca369
Compare
I've addressed the review comments, but I am running out of theories as to how to move forward on getting the CI to pass. Running |
This is an annoying issue with our pre-commit where we need |
Signed-off-by: Bill Murdock <bmurdock@redhat.com>
862bb61
to
6f669dc
Compare
Signed-off-by: Bill Murdock <bmurdock@redhat.com>
Thx, @ashwinb ! I had run into similar issues with code change PRs before but I hadn't thought carefully about the implications for documentation PRs. This seems to have sorted out the CI issues. I will open a separate PR to update CONTRIBUTING.md with this info too. |
Signed-off-by: Bill Murdock <bmurdock@redhat.com>
Signed-off-by: Bill Murdock <bmurdock@redhat.com>
What does this PR do?
Adds a subpage of the OpenAI compatibility page in the documentation. This subpage documents known limitations of the Responses API.
Closes #3575