Code

Pulling llama 3.3 70b from head#12

Code

Merged

rahul-sarvam merged 9 commits intosarvamai:mainsarvamai/torchtune:mainfrom pytorch:mainpytorch/torchtune:mainCopy head branch name to clipboardDec 8, 2024

+4,859-980

Commits

Commits on Dec 6, 2024

• Llama 3.3 70B (#2124)

  pbontrager

  authored
  bfaa533

  Copy full SHA for bfaa533

• Llama 3.3 readme updates (#2125)

  ebsmothers

  authored
  94561a4

  Copy full SHA for 94561a4

• update configs (#2107)

  Show description for 2b1ee6d
  

  felipemello1

  and

  Felipe Mello

  authored
  2b1ee6d

  Copy full SHA for 2b1ee6d

• Reduce logging output for distributed KD (#2120)

  joecummings

  authored
  f799211

  Copy full SHA for f799211

• Support Early Exit Loss and/or Layer Dropout (#1076)

  Show description for f8563dd
  

  mostafaelhoushi

  and

  ebsmothers

  authored
  f8563dd

  Copy full SHA for f8563dd

• Update checkpointing directory (#2074)

  Show description for 424ffc3
  

  3 peopleauthored
  424ffc3

  Copy full SHA for 424ffc3

• pass correct arg (#2127)

  Show description for fef2c80
  

  felipemello1

  and

  Felipe Mello

  authored
  fef2c80

  Copy full SHA for fef2c80

• update configs (#2128)

  Show description for 26b2200
  

  felipemello1

  and

  Felipe Mello

  authored
  26b2200

  Copy full SHA for 26b2200

Commits on Dec 7, 2024

• fix qat_lora_test (#2131)

  Show description for 06a8379
  

  felipemello1

  and

  Felipe Mello

  authored
  06a8379

  Copy full SHA for 06a8379