Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Issue]: Why is response_format ignored in groq? #77

Open
r4881t opened this issue Oct 21, 2024 · 1 comment
Open

[Issue]: Why is response_format ignored in groq? #77

r4881t opened this issue Oct 21, 2024 · 1 comment
Labels
alt-models Non-OpenAI Models / Client Classes

Comments

@r4881t
Copy link
Collaborator

r4881t commented Oct 21, 2024

Describe the issue

I looked into the code and found that response_format is ignored in groq.

# n (must be 1), response_format (to enforce JSON but needs prompting as well), user,

Why would this be? Similar params in OpenAI are not ignored.

Steps to reproduce

No response

Screenshots and logs

No response

Additional Information

No response

@marklysze
Copy link
Collaborator

Hey @r4881t, it's a good question... It's currently noted as a beta feature and in their documentation they note this against it: Important: when using JSON mode, you must also instruct the model to produce JSON yourself via a system or user message..

Would having the parameter be beneficial to you? If so, would you like to create a PR for it? I can assist if needed.

@marklysze marklysze added the alt-models Non-OpenAI Models / Client Classes label Oct 21, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
alt-models Non-OpenAI Models / Client Classes
Projects
None yet
Development

No branches or pull requests

2 participants