Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add vLLM on Ray microservice #285

Merged
merged 16 commits into from
Jul 12, 2024
Merged

Conversation

XinyaoWa
Copy link
Collaborator

@XinyaoWa XinyaoWa commented Jul 10, 2024

Description

Add vLLM on Ray microservice

Issues

#194 #257 #258

Type of change

  • New feature (non-breaking change which adds new functionality)

Dependencies

Tests

tests/test_llms_text-generation_vllm-ray.sh

XinyaoWa and others added 6 commits July 10, 2024 12:34
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
@XinyaoWa
Copy link
Collaborator Author

@chensuyue @lvliang-intel This PR is ready to merge, please help to have a review~

XinyaoWa and others added 8 commits July 10, 2024 16:06
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
@chensuyue chensuyue requested a review from lvliang-intel July 11, 2024 06:37
@chensuyue chensuyue merged commit ec3b2e8 into opea-project:main Jul 12, 2024
7 checks passed
dwhitena pushed a commit to predictionguard/GenAIComps that referenced this pull request Jul 24, 2024
Signed-off-by: Xinyao Wang <xinyao.wang@intel.com>
Signed-off-by: Daniel Whitenack <whitenack.daniel@gmail.com>
@XinyaoWa XinyaoWa deleted the vllm-ray-1 branch November 7, 2024 03:36
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants