Skip to content

Commit

Permalink
Revert "[Doc] RayServe Single-Host TPU v6e Example with vLLM (ray-pro…
Browse files Browse the repository at this point in the history
…ject#47814)"

This reverts commit e4a448f.
  • Loading branch information
kevin85421 committed Mar 6, 2025
1 parent ab6b495 commit 809edea
Show file tree
Hide file tree
Showing 4 changed files with 0 additions and 363 deletions.
2 changes: 0 additions & 2 deletions doc/source/cluster/kubernetes/examples.md
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,6 @@ examples/rayjob-kueue-gang-scheduling
examples/distributed-checkpointing-with-gcsfuse
examples/modin-example
examples/vllm-rayservice
examples/tpu-single-host-rayservice
```


Expand All @@ -37,4 +36,3 @@ This section presents example Ray workloads to try out on your Kubernetes cluste
- {ref}`kuberay-distributed-checkpointing-gcsefuse`
- {ref}`kuberay-modin-example`
- {ref}`kuberay-vllm-rayservice-example`
- {ref}`kuberay-tpu-single-host-vllm`
359 changes: 0 additions & 359 deletions doc/source/cluster/kubernetes/examples/tpu-single-host-rayservice.md

This file was deleted.

2 changes: 0 additions & 2 deletions doc/source/cluster/kubernetes/examples/vllm-rayservice.md
Original file line number Diff line number Diff line change
Expand Up @@ -4,8 +4,6 @@

This guide demonstrates how to [Serve a Large Language Model with vLLM](https://docs.ray.io/en/latest/serve/tutorials/vllm-example.html) on Kubernetes using KubeRay. The example in this guide deploys the `meta-llama/Meta-Llama-3-8B-Instruct` model from Hugging Face on Google Kubernetes Engine (GKE).

* This example uses vLLM with KubeRay. However, Ray provides a native [Serve LLM API](https://docs.ray.io/en/latest/serve/llm/overview.html) to enable users to deploy multiple LLM models together with the Ray Serve API. This API is the recommended path for running LLMs through Ray Serve.

## Prerequisites

This example downloads model weights from Hugging Face. You need to complete the following
Expand Down
Binary file not shown.

0 comments on commit 809edea

Please sign in to comment.