Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support TGI in Truss #486

Merged
merged 6 commits into from
Jul 31, 2023
Merged

Support TGI in Truss #486

merged 6 commits into from
Jul 31, 2023

Conversation

bolasim
Copy link
Collaborator

@bolasim bolasim commented Jul 28, 2023

No description provided.

@bolasim bolasim requested a review from aspctu July 28, 2023 22:15
@bolasim bolasim changed the title Bola/integrate tgi vllm into truss Support TGI in Truss Jul 28, 2023
@bolasim bolasim marked this pull request as ready for review July 28, 2023 23:50
pankajroark
pankajroark approved these changes Jul 29, 2023
View reviewed changes
Copy link
Collaborator

@pankajroark pankajroark left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great. Such a big step, supporting multiple server backends.

@bolasim bolasim merged commit 44c48eb into main Jul 31, 2023
@bolasim bolasim deleted the bola/integrate-tgi-vllm-into-truss branch July 31, 2023 19:34
@bolasim
Copy link
Collaborator Author

bolasim commented Aug 8, 2023

#520

@bolasim bolasim mentioned this pull request Aug 8, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@pankajroark pankajroark pankajroark approved these changes

@aspctu aspctu Awaiting requested review from aspctu

@squidarth squidarth Awaiting requested review from squidarth

@varunshenoy varunshenoy Awaiting requested review from varunshenoy

@joostinyi joostinyi Awaiting requested review from joostinyi

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@bolasim @pankajroark