Code

Add rope dynamic linear scaling#7437

Code

Merged

hsiehjackson merged 15 commits intomainNVIDIA/NeMo:mainfrom add-rope-dynamic-piNVIDIA/NeMo:add-rope-dynamic-piCopy head branch name to clipboardSep 18, 2023

+22-7

Commits

Commits on Sep 13, 2023

• Add dynamic linear scaling

  Show description for 41bacfb
  hsiehjackson

  committed
  41bacfb

  Copy full SHA for 41bacfb

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for d3bfde5
  pre-commit-ci[bot]

  committed
  d3bfde5

  Copy full SHA for d3bfde5

• Fix bug

  Show description for 694441f
  hsiehjackson

  committed
  694441f

  Copy full SHA for 694441f

• Fix conflict

  Show description for 64930a1
  hsiehjackson

  committed
  64930a1

  Copy full SHA for 64930a1

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 69dc432
  pre-commit-ci[bot]

  committed
  69dc432

  Copy full SHA for 69dc432

Commits on Sep 14, 2023

• Fix

  Show description for 5307599
  hsiehjackson

  committed
  5307599

  Copy full SHA for 5307599

• Merge branch 'add-rope-dynamic-pi' of https://github.com/NVIDIA/NeMo into add-rope-dynamic-pi

  hsiehjackson

  committed
  cb26491

  Copy full SHA for cb26491

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 3dc5bbf
  pre-commit-ci[bot]

  committed
  3dc5bbf

  Copy full SHA for 3dc5bbf

• Fix

  Show description for eb168f0
  hsiehjackson

  committed
  eb168f0

  Copy full SHA for eb168f0

• Merge branch 'add-rope-dynamic-pi' of https://github.com/NVIDIA/NeMo into add-rope-dynamic-pi

  hsiehjackson

  committed
  4f47581

  Copy full SHA for 4f47581

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 259ee01
  pre-commit-ci[bot]

  committed
  259ee01

  Copy full SHA for 259ee01

Commits on Sep 18, 2023

• Merge branch 'main' into add-rope-dynamic-pi

  yzhang123

  authored
  4ffc6ea

  Copy full SHA for 4ffc6ea

• Fix

  Show description for d5e2568
  hsiehjackson

  committed
  d5e2568

  Copy full SHA for d5e2568

• Merge branch 'add-rope-dynamic-pi' of https://github.com/NVIDIA/NeMo into add-rope-dynamic-pi

  hsiehjackson

  committed
  a6ea946

  Copy full SHA for a6ea946

• Merge branch 'main' into add-rope-dynamic-pi

  hsiehjackson

  authored
  4752eed

  Copy full SHA for 4752eed