Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fix system prompts for replicate #970

Merged

Conversation

nbaldwin98
Copy link
Contributor

fixes #952

Copy link

vercel bot commented Dec 1, 2023

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
litellm ✅ Ready (Inspect) Visit Preview 💬 Add feedback Dec 1, 2023 0:24am

@wendlerc
Copy link

wendlerc commented Dec 3, 2023

fixes the system prompts/prompts, but additional parameters like max_tokens are not passed correctly (some of them need to be renamed for replicate, where max_tokens is called max_new_tokens.

@krrishdholakia
Copy link
Contributor

lgtm! thanks for the work on this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

[Feature]: support multi-turn prompt templating for replicate
3 participants