Code

Support Sharding with PP_Degree > 1#2717

Code

Draft

HappyAmazonian wants to merge 21 commits intodeepjavalibrary:masterdeepjavalibrary/djl-serving:masterfrom HappyAmazonian:instance_sizeHappyAmazonian/djl-serving:instance_sizeCopy head branch name to clipboard

+54-40

Commits

Commits on Dec 31, 2024

• add integ tests executor link in PR template

  HappyAmazonian

  committed
  499cf57

  Copy full SHA for 499cf57

Commits on Jan 2, 2025

• try lmi-distro workflow

  HappyAmazonian

  committed
  d407f84

  Copy full SHA for d407f84

• Merge branch 'master' of https://github.com/deepjavalibrary/djl-serving into djl-master

  HappyAmazonian

  committed
  3a6bea4

  Copy full SHA for 3a6bea4

• add default value for input.mode in nightly workflow

  HappyAmazonian

  committed
  e1743ce

  Copy full SHA for e1743ce

• reset

  HappyAmazonian

  committed
  48e19cf

  Copy full SHA for 48e19cf

Commits on Jan 14, 2025

• test using aarch64 host for trtllm

  HappyAmazonian

  committed
  3c3c205

  Copy full SHA for 3c3c205

• add tests code

  HappyAmazonian

  committed
  d343a4c

  Copy full SHA for d343a4c

• add tests code/print

  HappyAmazonian

  committed
  1720f64

  Copy full SHA for 1720f64

• add tests code/print

  HappyAmazonian

  committed
  fa5cfb3

  Copy full SHA for fa5cfb3

• add tests code/print

  HappyAmazonian

  committed
  3dfe76e

  Copy full SHA for 3dfe76e

• add tests code/print

  HappyAmazonian

  committed
  794f989

  Copy full SHA for 794f989

• ready for pr

  HappyAmazonian

  committed
  02bf626

  Copy full SHA for 02bf626

• add new line at the end

  HappyAmazonian

  committed
  19c4359

  Copy full SHA for 19c4359

Commits on Feb 2, 2025

• mn sharding in progress

  HappyAmazonian

  committed
  a1adcb3

  Copy full SHA for a1adcb3

• Merge branch 'deepjavalibrary:master' into djl-master

  HappyAmazonian

  authored
  6dc35fb

  Copy full SHA for 6dc35fb

• Merge remote-tracking branch 'origin/djl-master' into instance_size

  HappyAmazonian

  committed
  1149a91

  Copy full SHA for 1149a91

Commits on Feb 5, 2025

• Merge branch 'deepjavalibrary:master' into djl-master

  HappyAmazonian

  authored
  8531d95

  Copy full SHA for 8531d95

• done

  HappyAmazonian

  committed
  458ee00

  Copy full SHA for 458ee00

• Merge branch 'djl-master' into instance_size

  HappyAmazonian

  committed
  b354078

  Copy full SHA for b354078

• reset Connection.java

  HappyAmazonian

  committed
  9ae615f

  Copy full SHA for 9ae615f

• format

  HappyAmazonian

  committed
  3e8e7c4

  Copy full SHA for 3e8e7c4