Skip to content

Commit ec32753

Browse files
committed
fix typo and add mount-workspace to vllm doc
1 parent f00d700 commit ec32753

File tree

1 file changed

+6
-6
lines changed

1 file changed

+6
-6
lines changed

examples/vllm/README.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -40,7 +40,7 @@ docker compose -f deploy/metrics/docker-compose.yml up -d
4040
```
4141

4242
```bash
43-
./container/run.sh -it --framework VLLM_V1
43+
./container/run.sh -it --framework VLLM_V1 --mount-workspace
4444
```
4545

4646
This includes the specific commit [vllm-project/vllm#19790](https://github.com/vllm-project/vllm/pull/19790) which enables support for external control of the DP ranks.
@@ -74,31 +74,31 @@ Note: The above architecture illustrates all the components. The final component
7474

7575
```bash
7676
# requires one gpu
77-
cd examples/vllm_v1
77+
cd examples/vllm
7878
bash launch/agg.sh
7979
```
8080

8181
#### Aggregated Serving with KV Routing
8282

8383
```bash
8484
# requires two gpus
85-
cd examples/vllm_v1
85+
cd examples/vllm
8686
bash launch/agg_router.sh
8787
```
8888

8989
#### Disaggregated Serving
9090

9191
```bash
9292
# requires two gpus
93-
cd examples/vllm_v1
93+
cd examples/vllm
9494
bash launch/disagg.sh
9595
```
9696

9797
#### Disaggregated Serving with KV Routing
9898

9999
```bash
100100
# requires three gpus
101-
cd examples/vllm_v1
101+
cd examples/vllm
102102
bash launch/disagg_router.sh
103103
```
104104

@@ -108,7 +108,7 @@ This example is not meant to be performant but showcases dynamo routing to data
108108

109109
```bash
110110
# requires four gpus
111-
cd examples/vllm_v1
111+
cd examples/vllm
112112
bash launch/dep.sh
113113
```
114114

0 commit comments

Comments
 (0)