Skip to content

Commit b725c26

Browse files
andyxningepwalsh
authored andcommitted
[Doc] add backend to doc string of initialize_model_parallel (vllm-project#22142)
Signed-off-by: Andy Xie <andy.xning@gmail.com>
1 parent d45bfa1 commit b725c26

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/distributed/parallel_state.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1013,6 +1013,7 @@ def initialize_model_parallel(
10131013
parallelism.
10141014
pipeline_model_parallel_size: number of GPUs used for pipeline model
10151015
parallelism.
1016+
backend: name of torch distributed communication backend.
10161017
10171018
Let's say we have a total of 8 GPUs denoted by g0 ... g7 and we
10181019
use 2 GPUs to parallelize the model tensor, and 4 GPUs to parallelize

0 commit comments

Comments
 (0)