Code

Lora soup#151

Code

Closed

shuishen112 wants to merge 35 commits intomainmicrosoft/mttl:mainfrom lora_soupmicrosoft/mttl:lora_soupCopy head branch name to clipboard

+627-17

Commits

Commits on Dec 1, 2024

• ad math

  shuishen112

  committed
  52c063e

  Copy full SHA for 52c063e

• add mathqa

  shuishen112

  committed
  d41d342

  Copy full SHA for d41d342

• isort

  shuishen112

  committed
  d4f0665

  Copy full SHA for d4f0665

Commits on Dec 2, 2024

• add alpaca datamodule

  shuishen112

  committed
  e774739

  Copy full SHA for e774739

• add alpaca code training

  shuishen112

  committed
  d5e2883

  Copy full SHA for d5e2883

Commits on Dec 6, 2024

• add gsm datamodule

  shuishen112

  committed
  a198621

  Copy full SHA for a198621

• add gsm evaluator(wip)

  shuishen112

  committed
  e64be33

  Copy full SHA for e64be33

Commits on Dec 12, 2024

• fix gsm evaluation

  shuishen112

  committed
  8b0ad0b

  Copy full SHA for 8b0ad0b

Commits on Dec 15, 2024

• fix finetuning moe

  shuishen112

  committed
  f85ac64

  Copy full SHA for f85ac64

Commits on Dec 16, 2024

• fix lib_mu

  shuishen112

  committed
  fed8aab

  Copy full SHA for fed8aab

• add lora soup selector

  shuishen112

  committed
  145335c

  Copy full SHA for 145335c

Commits on Dec 17, 2024

• register lora soup

  shuishen112

  committed
  ce608bf

  Copy full SHA for ce608bf

• fix lora soup finetuning

  shuishen112

  committed
  a1c9d3f

  Copy full SHA for a1c9d3f

• change routing name

  shuishen112

  committed
  a056d41

  Copy full SHA for a056d41

• add lora soup selector test

  shuishen112

  committed
  ef095c6

  Copy full SHA for ef095c6

Commits on Dec 19, 2024

• change gsm hard prompt

  shuishen112

  committed
  27527b9

  Copy full SHA for 27527b9

Commits on Dec 20, 2024

• fix source empty issue for mathqa

  shuishen112

  committed
  6ee4ec6

  Copy full SHA for 6ee4ec6

• use cot to evaluate the gsm8k-hard

  shuishen112

  committed
  7a0daf2

  Copy full SHA for 7a0daf2

• fix out of index issue

  shuishen112

  committed
  1ce5757

  Copy full SHA for 1ce5757

Commits on Dec 21, 2024

• add python code evaluator for gsm

  shuishen112

  committed
  e91ab0d

  Copy full SHA for e91ab0d

• fix gsm python code

  shuishen112

  committed
  9711704

  Copy full SHA for 9711704

Commits on Dec 22, 2024

• add gsm eval

  shuishen112

  committed
  b46c54c

  Copy full SHA for b46c54c

• add math

  shuishen112

  committed
  36ad6e4

  Copy full SHA for 36ad6e4

• fix test

  shuishen112

  committed
  8ff8b19

  Copy full SHA for 8ff8b19

Commits on Dec 23, 2024

• fix gsm evaluator

  shuishen112

  committed
  18e8585

  Copy full SHA for 18e8585

• add gsm evaluator

  shuishen112

  committed
  dce9b6e

  Copy full SHA for dce9b6e

• change the arg

  shuishen112

  committed
  5b541a0

  Copy full SHA for 5b541a0

Commits on Dec 24, 2024

• add gsm evaluator

  shuishen112

  committed
  3036dd6

  Copy full SHA for 3036dd6

Commits on Dec 28, 2024

• add alpaca math mix datamodule

  shuishen112

  committed
  c6a5ef7

  Copy full SHA for c6a5ef7

• Merge branch 'math_dataset' into lora_soup

  shuishen112

  committed
  7082f9b

  Copy full SHA for 7082f9b

• add mix math code training

  shuishen112

  committed
  d160bd5

  Copy full SHA for d160bd5

• logging

  shuishen112

  committed
  0d28605

  Copy full SHA for 0d28605

• fix filtering experts

  shuishen112

  committed
  6321495

  Copy full SHA for 6321495

Commits on Dec 30, 2024

• add lora_soup evaluation

  shuishen112

  committed
  d5a8728

  Copy full SHA for d5a8728

• lora soup only train the routing

  shuishen112

  committed
  dc2868c

  Copy full SHA for dc2868c