Code

[Core] Pipeline Parallel Support#4412

Code

Merged

youkaichao merged 6 commits intovllm-project:mainvllm-project/vllm:mainfrom andoorve:pipeline-parallelandoorve/vllm:pipeline-parallelCopy head branch name to clipboardJul 2, 2024

+1,100-404

Commits

Commits on Jul 2, 2024

• Pipeline Parallelism

  Show description for c85cde4
  andoorve

  committed
  c85cde4

• Make scheduler use pipeline parallel size directly

  Show description for beba5ed
  andoorve

  committed
  beba5ed

• Change ABC defaults for prepare_model_input

  Show description for 6fd17a3
  andoorve

  committed
  6fd17a3

• Add basic comm ops tests with TP and PP.

  Show description for ef62774
  andoorve

  committed
  ef62774

• Fix phi3v for test

  Show description for d9257a2
  andoorve

  committed
  d9257a2

• Address Nick nits and fix CUDAGraph correctness

  Show description for f9351fb
  andoorve

  committed
  f9351fb