Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Together AI vendor support. #346

Closed
enricoros opened this issue Jan 15, 2024 · 6 comments
Closed

Together AI vendor support. #346

enricoros opened this issue Jan 15, 2024 · 6 comments
Labels
feature-cool Distinctive features new-vendor
Milestone
1.11.0

Comments

@enricoros
Copy link
Owner

Add support for Together models; for instance, the new Nous Mixtral is released there first.
@enricoros enricoros self-assigned this Jan 15, 2024
@enricoros enricoros added this to the 1.11.0 milestone Jan 15, 2024
@enricoros
Copy link
Owner Author

Implemented full support, included description (context window) of the latest models, and rate limiting for the free tier.

1.11.0.-.Together.AI.support.-.2024-01-15.150641.mp4

@enricoros enricoros changed the title Support Together.ai Together AI vendor support. Jan 16, 2024
@enricoros
Copy link
Owner Author

Very fast performance!

1.11.0.-.Together.AI.support2.-.2024-01-15.162652.mp4

@enricoros enricoros mentioned this issue Jan 16, 2024
Closed
23 tasks
@enricoros enricoros removed their assignment Jan 16, 2024
@enricoros enricoros moved this from Ready to To Promote in big-AGI build-in-public roadmap Jan 16, 2024
@enricoros enricoros added the feature-cool Distinctive features label Jan 16, 2024
@qdrop17
Copy link

qdrop17 commented Jan 30, 2024

Awesome project indeed; unfortunately this feature seems to be broken atm; or there's an incompatibility with the API:

image

Unexpected token 'A', "An error o"... is not valid JSON

@enricoros
Copy link
Owner Author

@qdrop17 I just tried it now and it works perfectly here.

Screenshot_20240130_113543_Chrome.jpg

Did you self-deploy or used the hosted version?

Anything special related to your API key? (lmk if you are able to provide a temp key for me to try, to check under the same conditions)

@qdrop17
Copy link

qdrop17 commented Feb 6, 2024

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

@enricoros
Copy link
Owner Author

I self-deployed it. But the issue resolved itself when I retried. Maybe a temporary issue with the TogetherAI API.

Thanks, very possible.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
feature-cool Distinctive features new-vendor
Projects
big-AGI build-in-public roadmap
Status: To Promote
Milestone
1.11.0
Development

No branches or pull requests
2 participants
@enricoros @qdrop17