Code

PyTorch native 2D LLaMA inference#922

Code

Open

kwen2501 wants to merge 6 commits intomainpytorch/PiPPy:mainfrom 2d_llamapytorch/PiPPy:2d_llamaCopy head branch name to clipboard

+100-1

Commits

Commits on Jan 2, 2024

• 2D working without TP self attention

  kwen2501

  committed
  e90d41c

  Copy full SHA for e90d41c

• Modify view ops to make them compatible with TP

  kwen2501

  committed
  78ccf59

  Copy full SHA for 78ccf59

• Comments

  kwen2501

  committed
  ab40031

  Copy full SHA for ab40031

• adding deferred init as Ke advised

  

  HamidShojanazeri

  authored and

  kwen2501

  committed
  0cc816d

  Copy full SHA for 0cc816d

• Remove modify_view()

  kwen2501

  committed
  37e110c

  Copy full SHA for 37e110c

• Rearrange code

  kwen2501

  committed
  c0f6152

  Copy full SHA for c0f6152