Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

LLM on Gaudi by vLLM + Ray #257

Closed
kevinintel opened this issue Jun 28, 2024 · 0 comments
Closed

LLM on Gaudi by vLLM + Ray #257

kevinintel opened this issue Jun 28, 2024 · 0 comments
Assignees
@XinyaoWa
Milestone
v0.8

Comments

@kevinintel
Copy link
Collaborator

LLM on Gaudi by vLLM + Ray
@kevinintel kevinintel added this to OPEA Jun 28, 2024
@kevinintel kevinintel added this to the v0.8 milestone Jun 28, 2024
@kevinintel kevinintel linked a pull request Jul 1, 2024 that will close this issue
Add vLLM on Ray microservice #245
Closed
1 task
@XinyaoWa XinyaoWa mentioned this issue Jul 18, 2024
Merged
1 task
@github-project-automation github-project-automation bot moved this to Done in OPEA Jul 18, 2024
lkk12014402 pushed a commit that referenced this issue Aug 8, 2024
@louie-tsai
[DocSums] Fix doc sum issues (#257)
29de55d 
* Update README.md for docker instruction issues

some fixes for docker build instructions

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>

* Update README.md for new frontend

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>

* Update README.md for output example

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>

* pre-commit change

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>

* fix for pre-commit

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>

---------

Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@XinyaoWa XinyaoWa

Labels
None yet
Projects
OPEA
Status: Done
Milestone
v0.8
Development

Successfully merging a pull request may close this issue.

Add vLLM on Ray microservice XinyaoWa/GenAIComps
2 participants
@XinyaoWa @kevinintel