Code

Fix segfaults#641

Code

Merged

danielhanchen merged 157 commits intomainunslothai/unsloth:mainfrom nightlyunslothai/unsloth:nightlyCopy head branch name to clipboardJun 14, 2024

+90-348

Commits

Commits on May 19, 2024

• Update llama.py

  danielhanchen

  committed
  7df08c4

• offload

  danielhanchen

  committed
  ba5b6ce

• Update llama.py

  danielhanchen

  committed
  a07057e

• Update llama.py

  danielhanchen

  committed
  4be9063

• Update llama.py

  danielhanchen

  committed
  3dc3d3f

• Update llama.py

  danielhanchen

  committed
  f1cc1e8

• Update llama.py

  danielhanchen

  committed
  5cb531a

• Update llama.py

  danielhanchen

  committed
  6bd8e60

• Update llama.py

  danielhanchen

  committed
  d1d57ff

Commits on May 20, 2024

• continued pretraining trainer

  danielhanchen

  committed
  7470f67

• Update trainer.py

  danielhanchen

  committed
  da9c1a6

• Update trainer.py

  danielhanchen

  committed
  2c68f56

• Update trainer.py

  danielhanchen

  committed
  217bf9d

Commits on May 21, 2024

• Update trainer.py

  danielhanchen

  committed
  6e85384

• is_bfloat16_supported

  danielhanchen

  committed
  77f9c51

• Update __init__.py

  danielhanchen

  committed
  c0e1d27

• Update README.md

  danielhanchen

  committed
  2b23b93

• Update llama.py

  danielhanchen

  committed
  902e23a

Commits on May 22, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  98f41ce

• is_bfloat16_supported

  danielhanchen

  committed
  3193cac

• Update __init__.py

  danielhanchen

  committed
  dfeaf4b

• Mistral v3

  danielhanchen

  committed
  1e84090

Commits on May 23, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  f63f32b

• Phi 3 medium

  danielhanchen

  committed
  57ad8e7

• Update chat_templates.py

  danielhanchen

  committed
  2b994b2

• Update chat_templates.py

  danielhanchen

  committed
  ff8171f

• Phi-3

  danielhanchen

  authored
  5ca8b58

• Merge branch 'main' into nightly

  danielhanchen

  committed
  98c2e81

• Merge branch 'main' into nightly

  danielhanchen

  committed
  3817660

Commits on May 24, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  f858145

• Update save.py

  danielhanchen

  committed
  a1328f6

Commits on May 25, 2024

• Update README.md

  Show description for fb29673
  shimmyshimmer

  authored
  fb29673

Commits on May 26, 2024

• Untrained tokens

  danielhanchen

  committed
  fa85556

• Update tokenizer_utils.py

  danielhanchen

  committed
  c511aca

• Update tokenizer_utils.py

  danielhanchen

  committed
  35e7355

• Update tokenizer_utils.py

  danielhanchen

  committed
  cc0bf44

• Update tokenizer_utils.py

  danielhanchen

  committed
  674ba66

• Update tokenizer_utils.py

  danielhanchen

  committed
  9823f52

• Update tokenizer_utils.py

  danielhanchen

  committed
  c0c761b

• Update tokenizer_utils.py

  danielhanchen

  committed
  e2850c0

• Update tokenizer_utils.py

  danielhanchen

  committed
  8e12780

• Update tokenizer_utils.py

  danielhanchen

  committed
  6f1855e

• Update tokenizer_utils.py

  danielhanchen

  committed
  d27b173

• Update tokenizer_utils.py

  danielhanchen

  committed
  7bf7399

• Update tokenizer_utils.py

  danielhanchen

  committed
  31ecef9

• Update tokenizer_utils.py

  danielhanchen

  committed
  b67d93f

• Update tokenizer_utils.py

  danielhanchen

  committed
  e874ccd

Commits on May 27, 2024

• Update tokenizer_utils.py

  danielhanchen

  committed
  d7b54ff

• Update tokenizer_utils.py

  danielhanchen

  committed
  5a4a512

• Update tokenizer_utils.py

  danielhanchen

  committed
  82c040e

• Update tokenizer_utils.py

  danielhanchen

  committed
  8e227b2

• Update tokenizer_utils.py

  danielhanchen

  committed
  250d386

• Update llama.py

  danielhanchen

  committed
  e6db3ba

• Update tokenizer_utils.py

  danielhanchen

  committed
  e673fa2

• Update tokenizer_utils.py

  danielhanchen

  committed
  222b835

• Update tokenizer_utils.py

  danielhanchen

  committed
  6404aa5

• Update tokenizer_utils.py

  danielhanchen

  committed
  cfea7b2

• Update save.py

  danielhanchen

  committed
  083e5ba

• Update save.py

  danielhanchen

  committed
  6f2565c

• Update save.py

  danielhanchen

  committed
  c19b04e

Commits on May 28, 2024

• checkpoint

  danielhanchen

  committed
  64b12a2

• Merge branch 'main' into nightly

  danielhanchen

  committed
  4cd5a8a

• Update _utils.py

  danielhanchen

  committed
  196faec

Commits on May 29, 2024

• Update tokenizer_utils.py

  danielhanchen

  committed
  235be40

• Update tokenizer_utils.py

  danielhanchen

  committed
  cf9090a

• Update tokenizer_utils.py

  danielhanchen

  committed
  1fb1110

Commits on May 30, 2024

• Update llama.py

  danielhanchen

  committed
  d1bd60c

• accelerate

  danielhanchen

  committed
  732ead0

• Update _utils.py

  danielhanchen

  committed
  359ae5c

• Update _utils.py

  danielhanchen

  committed
  8dcfad3

• Update _utils.py

  danielhanchen

  committed
  2bafc57

• Update _utils.py

  danielhanchen

  committed
  90f6311

• Update _utils.py

  danielhanchen

  committed
  7b84ff7

• Update _utils.py

  danielhanchen

  committed
  60f4b9a

• Update _utils.py

  danielhanchen

  committed
  3ebe5a5

• Update tokenizer_utils.py

  danielhanchen

  committed
  7bbc8ce

• train_dataloader

  danielhanchen

  committed
  6f5c84c

• Update llama.py

  danielhanchen

  committed
  0d269ca

• Update llama.py

  danielhanchen

  committed
  6b7c142

• Update llama.py

  danielhanchen

  committed
  54f3a74

• use_fast_convert

  danielhanchen

  committed
  0bc96c5

• Merge branch 'main' into nightly

  danielhanchen

  committed
  02c91b0

• Merge branch 'main' into nightly

  danielhanchen

  committed
  b384ff0

• Update save.py

  danielhanchen

  committed
  a8b5d89

• Update save.py

  danielhanchen

  committed
  872d569

• Update save.py

  danielhanchen

  committed
  3a1f5f2

Commits on Jun 2, 2024

• Update save.py

  danielhanchen

  committed
  bcadc8c

• remove_special_tokens

  danielhanchen

  committed
  1381820

• Ollama

  danielhanchen

  committed
  e01b87d

Commits on Jun 3, 2024

• Update chat_templates.py

  danielhanchen

  committed
  b3479c7

• Update chat_templates.py

  danielhanchen

  committed
  86804dc

• Update chat_templates.py

  danielhanchen

  committed
  87fdd3a

Commits on Jun 7, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  5c5df69

• Update llama.py

  danielhanchen

  committed
  6386d94

Commits on Jun 9, 2024

• Update chat_templates.py

  danielhanchen

  committed
  b1a9551

• Support bfloat16 GGUF

  danielhanchen

  committed
  344a05d

• Update save.py

  danielhanchen

  committed
  6b11e0d

• Update llama.py

  danielhanchen

  committed
  c6e4b5b

• fast_forward_inference

  danielhanchen

  committed
  57f29ab

• Update mapper.py

  danielhanchen

  committed
  d32e972

• Update loader.py

  danielhanchen

  committed
  e121fa5

• Update llama.py

  danielhanchen

  committed
  5eaa10f

Commits on Jun 10, 2024

• Update tokenizer_utils.py

  danielhanchen

  committed
  f57d28d

Commits on Jun 11, 2024

• info

  danielhanchen

  committed
  8937507

• edits

  danielhanchen

  committed
  8982edb

• Create chat template

  danielhanchen

  committed
  8904605

Commits on Jun 12, 2024

• Fix tokenizer

  danielhanchen

  committed
  2a374c2

Commits on Jun 13, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  d704b73

• Update tokenizer_utils.py

  danielhanchen

  committed
  8176155

• fix case where gguf saving fails due to first_conversion dtype (#630)

  chrehall68

  authored
  21a99f1

• Support revision parameter in FastLanguageModel.from_pretrained (#629)

  Show description for dbf2dcf
  chrehall68

  authored
  dbf2dcf

• clears any selected_adapters before calling internal_model.save_pretrained (#609)

  neph1

  authored
  9016171

• Update __init__.py (#602)

  Show description for 0428920
  xyangk

  authored
  0428920

• Fixed unsloth/tokenizer_utils.py for chat training (#604)

  Oseltamivir

  authored
  9fdd847

• Add GGML saving option to Unsloth for easier Ollama model creation and testing. (#345)

  Show description for b5fc6aa
  mahiatlinux

  authored
  b5fc6aa

• docs: Add LoraConfig parameters documentation (#619)

  sebdg

  authored
  3fafbf7

• llama.cpp failing (#371)

  Show description for 273a871
  

  bet0x

  and

  danielhanchen

  authored
  273a871

• fix libcuda_dirs import for triton 3.0 (#227)

  Show description for b312b3f
  

  t-vi

  and

  danielhanchen

  authored
  b312b3f

• Update save.py

  danielhanchen

  committed
  1601dca

• Update __init__.py

  danielhanchen

  committed
  26dc502

• Update fast_lora.py

  danielhanchen

  committed
  6a51657

• Update save.py

  danielhanchen

  committed
  4a8ba90

• Update save.py

  danielhanchen

  committed
  0abb5ba

• Update save.py

  danielhanchen

  committed
  b24dd05

• Update loader.py

  danielhanchen

  committed
  48c6d6d

• Update save.py

  danielhanchen

  committed
  e35f608

• Update save.py

  danielhanchen

  committed
  4822eae

• quantize now llama-quantize

  danielhanchen

  committed
  7d847ed

• Update chat_templates.py

  danielhanchen

  committed
  82f10cb

• Update loader.py

  danielhanchen

  committed
  08424f0

• Update mapper.py

  danielhanchen

  committed
  eb906d0

• Update __init__.py

  danielhanchen

  committed
  0a304ae

• embedding size

  danielhanchen

  committed
  71edc42

• Merge branch 'main' into nightly

  danielhanchen

  committed
  411b881

• Update qwen2.py

  danielhanchen

  committed
  b74e321

Commits on Jun 14, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  9c6d415

• docs

  danielhanchen

  committed
  b82277f

• Update README.md

  danielhanchen

  committed
  d98e45e

• Update qwen2.py

  danielhanchen

  committed
  b6f0fdb

• README: Fix minor typo. (#559)

  Show description for 6c031e4
  

  shaper

  and

  danielhanchen

  authored
  6c031e4

• Update mistral.py

  danielhanchen

  committed
  2401dee

• Update qwen2.py

  danielhanchen

  committed
  1b93d7e

• Update qwen2.py

  danielhanchen

  committed
  3581037

• Update qwen2.py

  danielhanchen

  committed
  b56b8b8

• Update llama.py

  danielhanchen

  committed
  fe8c064

• Update llama.py

  danielhanchen

  committed
  d8d332a

• Update llama.py

  danielhanchen

  committed
  cdb1dbb

• Update README.md

  danielhanchen

  committed
  e8b3cf0

• FastMistralModel

  danielhanchen

  committed
  7e6f000

• Update mistral.py

  danielhanchen

  committed
  28995ab

• Update mistral.py

  danielhanchen

  committed
  515b1ae

• Update mistral.py

  danielhanchen

  committed
  7f28209

• Update mistral.py

  danielhanchen

  committed
  453cc48

• Update mistral.py

  danielhanchen

  committed
  6633d4a

• Auto check rope scaling

  danielhanchen

  committed
  e5bf125

• Merge branch 'main' into nightly

  danielhanchen

  committed
  d4f4bce

• Update llama.py

  danielhanchen

  committed
  341565b