Code

Enhance Llama model Integration#22

Code

Merged

tanganke merged 35 commits intomaintanganke/fusion_bench:mainfrom llamatanganke/fusion_bench:llamaCopy head branch name to clipboardOct 31, 2024

+3,964-149

Commits

Commits on Oct 29, 2024

• add Dare simple_average

  tanganke

  committed
  7026685

  Copy full SHA for 7026685

• partial update

  tanganke

  committed
  72c21bb

  Copy full SHA for 72c21bb

• partial update

  tanganke

  committed
  68ee6be

  Copy full SHA for 68ee6be

• Enhance LLaMA model integration

  tanganke

  committed
  a4cc970

  Copy full SHA for a4cc970

• Update utils

  Show description for d09ca14
  tanganke

  committed
  d09ca14

  Copy full SHA for d09ca14

Commits on Oct 30, 2024

• Enhance LLaMA model integration

  tanganke

  committed
  dcdeb1b

  Copy full SHA for dcdeb1b

• Update utils modified: fusion_bench/utils/devices.py modified: fusion_bench/utils/parameters.py

  tanganke

  committed
  71a9291

  Copy full SHA for 71a9291

• add collator and template

  tanganke

  committed
  9bad0eb

  Copy full SHA for 9bad0eb

• update data utils for llama models

  tanganke

  committed
  d722c1a

  Copy full SHA for d722c1a

• add collator and template

  tanganke

  committed
  d0b0884

  Copy full SHA for d0b0884

• update data utils for llama models

  tanganke

  committed
  a66f396

  Copy full SHA for a66f396

• update data for llama models

  tanganke

  committed
  bcefd49

  Copy full SHA for bcefd49

• update llama adamerging

  tanganke

  committed
  ccfc3c2

  Copy full SHA for ccfc3c2

• update data for llama models

  tanganke

  committed
  a58cb45

  Copy full SHA for a58cb45

• update llama adamerging

  tanganke

  committed
  c68b7d2

  Copy full SHA for c68b7d2

• update llama_sft adamerging

  tanganke

  committed
  a4a6c89

  Copy full SHA for a4a6c89

• update llama_sft adamerging

  tanganke

  committed
  3538534

  Copy full SHA for 3538534

• update config

  tanganke

  committed
  46ae4b6

  Copy full SHA for 46ae4b6

• update config

  tanganke

  committed
  be0442e

  Copy full SHA for be0442e

• update code

  tanganke

  committed
  18717f0

  Copy full SHA for 18717f0

• update code

  tanganke

  committed
  8268d7a

  Copy full SHA for 8268d7a

Commits on Oct 31, 2024

• refactor: rename BaseModelFusionAlgorithm to BaseAlgorithm

  Show description for e306e38
  tanganke

  committed
  e306e38

  Copy full SHA for e306e38

• Update llama_sft.yaml, llama_adamerging.py, layer_wise_fusion.py.

  tanganke

  committed
  b37a63a

  Copy full SHA for b37a63a

• Merge branch 'llama' of https://github.com/tanganke/fusion_bench into llama

  tanganke

  committed
  855460a

  Copy full SHA for 855460a

• fix bugs

  tanganke

  committed
  418a802

  Copy full SHA for 418a802

• add TaskVectorViolinPlot

  Show description for 8a5806f
  tanganke

  committed
  8a5806f

  Copy full SHA for 8a5806f

• optimize task_vector_violin_plot

  tanganke

  committed
  aa3b318

  Copy full SHA for aa3b318

• Add squad.py, update docs

  tanganke

  committed
  2ec72e4

  Copy full SHA for 2ec72e4

• add AdamW mixin

  tanganke

  committed
  c53288c

  Copy full SHA for c53288c

• rename squad.py and wikitext.py

  tanganke

  committed
  67688c3

  Copy full SHA for 67688c3

• new file: fusion_bench/dataset/llama/alpaca.py

  tanganke

  committed
  37e1ab3

  Copy full SHA for 37e1ab3

• add sharegpt.py

  tanganke

  committed
  d0acaaa

  Copy full SHA for d0acaaa

• update sharegpt.py

  tanganke

  committed
  aacdc97

  Copy full SHA for aacdc97

• remove unused files

  tanganke

  committed
  5d3e2f8

  Copy full SHA for 5d3e2f8

• update

  tanganke

  committed
  ea0cfa5

  Copy full SHA for ea0cfa5