Code

Generalize convert scripts#3838

Code

Merged

Galunid merged 43 commits intoggerganov:masterggerganov/llama.cpp:masterfrom Galunid:generic-convertGalunid/llama.cpp:generic-convertCopy head branch name to clipboardNov 9, 2023

+893-1,432

Commits

Commits on Oct 26, 2023

• Initial generic convert script

  Galunid

  committed
  4823b9b

  Copy full SHA for 4823b9b

Commits on Oct 27, 2023

• Remove comments

  Galunid

  committed
  2220124

  Copy full SHA for 2220124

Commits on Oct 28, 2023

• Make gguf_writer member of Model, rework tokenizer export

  Galunid

  committed
  0ff2371

  Copy full SHA for 0ff2371

• Add [UNTESTED] Baichuan support

  Galunid

  committed
  8618b4e

  Copy full SHA for 8618b4e

Commits on Oct 29, 2023

• Missing variable

  Galunid

  committed
  989db34

  Copy full SHA for 989db34

• Missing variable

  Galunid

  committed
  550b925

  Copy full SHA for 550b925

• Call add_tensor before write_* functions

  Galunid

  committed
  443f7d5

  Copy full SHA for 443f7d5

Commits on Oct 31, 2023

• MPT conversion fix

  Galunid

  committed
  08918b7

  Copy full SHA for 08918b7

• Get rid of dumb print

  Galunid

  committed
  3bb9844

  Copy full SHA for 3bb9844

• Add Falcon support

  Galunid

  committed
  0afa75a

  Copy full SHA for 0afa75a

• Add Starcoder and Refact

  Galunid

  committed
  94ba1db

  Copy full SHA for 94ba1db

• [Untested] Initial Persimmon support

  Galunid

  committed
  6f6856c

  Copy full SHA for 6f6856c

• Woops

  Galunid

  committed
  b9c664a

  Copy full SHA for b9c664a

• Fix variable

  Galunid

  committed
  0743f7a

  Copy full SHA for 0743f7a

• Add another alias to n_layers

  Galunid

  committed
  dc3115f

  Copy full SHA for dc3115f

• Flake8 fixes

  Galunid

  committed
  b2ba44e

  Copy full SHA for b2ba44e

• Rework tokenizer handling

  Galunid

  committed
  c94df09

  Copy full SHA for c94df09

• Small refactor

  Galunid

  committed
  235acc1

  Copy full SHA for 235acc1

• Remove 'old' conversion scripts

  Galunid

  committed
  f4b9a7e

  Copy full SHA for f4b9a7e

• Use 'IntEnum' instead of 'Enum'

  Galunid

  committed
  3ec89dc

  Copy full SHA for 3ec89dc

Commits on Nov 1, 2023

• Review fixes, persimmon fixes

  Galunid

  committed
  4fdd7cd

  Copy full SHA for 4fdd7cd

Commits on Nov 2, 2023

• fix mypy errors

  cebtenzzre

  committed
  8f31dc5

  Copy full SHA for 8f31dc5

• sort imports

  cebtenzzre

  committed
  66ccd62

  Copy full SHA for 66ccd62

• fix linter complaints

  cebtenzzre

  committed
  e9abcc9

  Copy full SHA for e9abcc9

• model.py : add missing future import

  cebtenzzre

  committed
  007be85

  Copy full SHA for 007be85

Commits on Nov 4, 2023

• Restore support for RWForCausalLM

  Galunid

  committed
  03c9683

  Copy full SHA for 03c9683

• Add big endian support

  Galunid

  committed
  fd30850

  Copy full SHA for fd30850

• Revert "Remove 'old' conversion scripts" - needed for testing

  Show description for e64f4de
  Galunid

  committed
  e64f4de

  Copy full SHA for e64f4de

• Yarn rope for baichuan

  Galunid

  committed
  2120195

  Copy full SHA for 2120195

• Rename convert-generic -> convert-hf-to-gguf

  Galunid

  committed
  087f88c

  Copy full SHA for 087f88c

• Move util to gguf-py/gguf

  Galunid

  committed
  f7de892

  Copy full SHA for f7de892

Commits on Nov 5, 2023

• Move everything to convert-hf-to-gguf.py

  Galunid

  committed
  781bc54

  Copy full SHA for 781bc54

• address review comments

  cebtenzzre

  committed
  fefc3db

  Copy full SHA for fefc3db

Commits on Nov 6, 2023

• Fix flake8 complaints

  Galunid

  committed
  648252e

  Copy full SHA for 648252e

• sort imports

  cebtenzzre

  committed
  05fb6f4

  Copy full SHA for 05fb6f4

Commits on Nov 7, 2023

• store_true defaults to False, not None

  Galunid

  committed
  7a3433b

  Copy full SHA for 7a3433b

• Change ftype from int value to str value

  Galunid

  committed
  73780f5

  Copy full SHA for 73780f5

• Review fixes

  Galunid

  committed
  88b0d9e

  Copy full SHA for 88b0d9e

• Rename variable

  Galunid

  committed
  b714883

  Copy full SHA for b714883

• parse_args improvements

  Galunid

  committed
  6a83bce

  Copy full SHA for 6a83bce

Commits on Nov 8, 2023

• Remove outdated scripts

  Galunid

  committed
  2862d16

  Copy full SHA for 2862d16

• Merge branch 'master' into generic-convert

  Galunid

  committed
  c79c358

  Copy full SHA for c79c358

Commits on Nov 9, 2023

• Fix import path

  Galunid

  committed
  2789ad9

  Copy full SHA for 2789ad9