Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[NA] Relax litellm dependency #751

Merged
merged 4 commits into from
Nov 28, 2024
Merged

[NA] Relax litellm dependency #751

merged 4 commits into from
Nov 28, 2024
+278 −14

Conversation

alexkuzmik
Copy link
Collaborator

@alexkuzmik alexkuzmik commented Nov 28, 2024 •
edited
Loading

Details

  • Relaxed litellm dependency.
  • Added post-filtering step for supported model params returned by litellm.
  • Exclude response_format from supported params for groq and ollama providers if litellm<1.52.15.
  • Updated Hallucination template a bit to reduce chance of non-json output when response_format is not used.
  • Added semantic_version module from comet_ml.

Testing

Manually tested with groq provider and different litellm versions.

@alexkuzmik alexkuzmik requested a review from a team as a code owner November 28, 2024 11:10
@alexkuzmik alexkuzmik self-assigned this Nov 28, 2024
@alexkuzmik alexkuzmik merged commit a703e02 into main Nov 28, 2024
23 checks passed
@alexkuzmik alexkuzmik deleted the relax-litellm-dependency branch November 28, 2024 12:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@japdubengsub japdubengsub japdubengsub approved these changes

Assignees

@alexkuzmik alexkuzmik

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@alexkuzmik @japdubengsub