-
-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Support Anthropic Claude 3 #443
Comments
This pr does not seem to work for me. Error message stating it requires the new messages api. |
Ah there was an API change as well? |
It seems like it, other claude models work, just not Claude 3 |
https://docs.anthropic.com/claude/docs/models-overview#model-comparison All Claude 3 models only support the Messages API and I think currently only the completions API is implemented for Claude here? |
Correct @Penagwin - they just introduced the new Messages API and the Claude 3 models are the ones to only support that new API. We'll need to update the backend code. |
Is this the backend code for claude: https://github.com/enricoros/big-AGI/blob/main/src/modules/llms/server/anthropic/anthropic.router.ts Might be interested in taking a crack at this |
Hey everyone! 👋 I've taken a crack at adding support for Anthropic Claude 3 models, as mentioned by @enricoros and @Penagwin. The changes primarily focus on updating the backend code in anthropic.router.ts to use the new Anthropic Messages API. Here's a quick rundown of what I've done: 🔧 Updated the backend code to use the new Messages API, as required by Claude 3 models. Thanks for your time, and let me know if you have any questions or suggestions! 😄 |
Thanks @slapglif - looking into it. Seems like there's no Streaming support; looking into that. |
@enricoros
|
Looking for PR to add support for Claude 3, released today by Anthropic.
The text was updated successfully, but these errors were encountered: