Code

Nightly#673

Code

Merged

danielhanchen merged 234 commits intomainunslothai/unsloth:mainfrom nightlyunslothai/unsloth:nightlyCopy head branch name to clipboardJun 20, 2024

+21-43

Commits

Commits on May 19, 2024

• Update llama.py

  danielhanchen

  committed
  7df08c4

• offload

  danielhanchen

  committed
  ba5b6ce

• Update llama.py

  danielhanchen

  committed
  a07057e

• Update llama.py

  danielhanchen

  committed
  4be9063

• Update llama.py

  danielhanchen

  committed
  3dc3d3f

• Update llama.py

  danielhanchen

  committed
  f1cc1e8

• Update llama.py

  danielhanchen

  committed
  5cb531a

• Update llama.py

  danielhanchen

  committed
  6bd8e60

• Update llama.py

  danielhanchen

  committed
  d1d57ff

Commits on May 20, 2024

• continued pretraining trainer

  danielhanchen

  committed
  7470f67

• Update trainer.py

  danielhanchen

  committed
  da9c1a6

• Update trainer.py

  danielhanchen

  committed
  2c68f56

• Update trainer.py

  danielhanchen

  committed
  217bf9d

Commits on May 21, 2024

• Update trainer.py

  danielhanchen

  committed
  6e85384

• is_bfloat16_supported

  danielhanchen

  committed
  77f9c51

• Update __init__.py

  danielhanchen

  committed
  c0e1d27

• Update README.md

  danielhanchen

  committed
  2b23b93

• Update llama.py

  danielhanchen

  committed
  902e23a

Commits on May 22, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  98f41ce

• is_bfloat16_supported

  danielhanchen

  committed
  3193cac

• Update __init__.py

  danielhanchen

  committed
  dfeaf4b

• Mistral v3

  danielhanchen

  committed
  1e84090

Commits on May 23, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  f63f32b

• Phi 3 medium

  danielhanchen

  committed
  57ad8e7

• Update chat_templates.py

  danielhanchen

  committed
  2b994b2

• Update chat_templates.py

  danielhanchen

  committed
  ff8171f

• Phi-3

  danielhanchen

  authored
  5ca8b58

• Merge branch 'main' into nightly

  danielhanchen

  committed
  98c2e81

• Merge branch 'main' into nightly

  danielhanchen

  committed
  3817660

Commits on May 24, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  f858145

• Update save.py

  danielhanchen

  committed
  a1328f6

Commits on May 25, 2024

• Update README.md

  Show description for fb29673
  shimmyshimmer

  authored
  fb29673

Commits on May 26, 2024

• Untrained tokens

  danielhanchen

  committed
  fa85556

• Update tokenizer_utils.py

  danielhanchen

  committed
  c511aca

• Update tokenizer_utils.py

  danielhanchen

  committed
  35e7355

• Update tokenizer_utils.py

  danielhanchen

  committed
  cc0bf44

• Update tokenizer_utils.py

  danielhanchen

  committed
  674ba66

• Update tokenizer_utils.py

  danielhanchen

  committed
  9823f52

• Update tokenizer_utils.py

  danielhanchen

  committed
  c0c761b

• Update tokenizer_utils.py

  danielhanchen

  committed
  e2850c0

• Update tokenizer_utils.py

  danielhanchen

  committed
  8e12780

• Update tokenizer_utils.py

  danielhanchen

  committed
  6f1855e

• Update tokenizer_utils.py

  danielhanchen

  committed
  d27b173

• Update tokenizer_utils.py

  danielhanchen

  committed
  7bf7399

• Update tokenizer_utils.py

  danielhanchen

  committed
  31ecef9

• Update tokenizer_utils.py

  danielhanchen

  committed
  b67d93f

• Update tokenizer_utils.py

  danielhanchen

  committed
  e874ccd

Commits on May 27, 2024

• Update tokenizer_utils.py

  danielhanchen

  committed
  d7b54ff

• Update tokenizer_utils.py

  danielhanchen

  committed
  5a4a512

• Update tokenizer_utils.py

  danielhanchen

  committed
  82c040e

• Update tokenizer_utils.py

  danielhanchen

  committed
  8e227b2

• Update tokenizer_utils.py

  danielhanchen

  committed
  250d386

• Update llama.py

  danielhanchen

  committed
  e6db3ba

• Update tokenizer_utils.py

  danielhanchen

  committed
  e673fa2

• Update tokenizer_utils.py

  danielhanchen

  committed
  222b835

• Update tokenizer_utils.py

  danielhanchen

  committed
  6404aa5

• Update tokenizer_utils.py

  danielhanchen

  committed
  cfea7b2

• Update save.py

  danielhanchen

  committed
  083e5ba

• Update save.py

  danielhanchen

  committed
  6f2565c

• Update save.py

  danielhanchen

  committed
  c19b04e

Commits on May 28, 2024

• checkpoint

  danielhanchen

  committed
  64b12a2

• Merge branch 'main' into nightly

  danielhanchen

  committed
  4cd5a8a

• Update _utils.py

  danielhanchen

  committed
  196faec

Commits on May 29, 2024

• Update tokenizer_utils.py

  danielhanchen

  committed
  235be40

• Update tokenizer_utils.py

  danielhanchen

  committed
  cf9090a

• Update tokenizer_utils.py

  danielhanchen

  committed
  1fb1110

Commits on May 30, 2024

• Update llama.py

  danielhanchen

  committed
  d1bd60c

• accelerate

  danielhanchen

  committed
  732ead0

• Update _utils.py

  danielhanchen

  committed
  359ae5c

• Update _utils.py

  danielhanchen

  committed
  8dcfad3

• Update _utils.py

  danielhanchen

  committed
  2bafc57

• Update _utils.py

  danielhanchen

  committed
  90f6311

• Update _utils.py

  danielhanchen

  committed
  7b84ff7

• Update _utils.py

  danielhanchen

  committed
  60f4b9a

• Update _utils.py

  danielhanchen

  committed
  3ebe5a5

• Update tokenizer_utils.py

  danielhanchen

  committed
  7bbc8ce

• train_dataloader

  danielhanchen

  committed
  6f5c84c

• Update llama.py

  danielhanchen

  committed
  0d269ca

• Update llama.py

  danielhanchen

  committed
  6b7c142

• Update llama.py

  danielhanchen

  committed
  54f3a74

• use_fast_convert

  danielhanchen

  committed
  0bc96c5

• Merge branch 'main' into nightly

  danielhanchen

  committed
  02c91b0

• Merge branch 'main' into nightly

  danielhanchen

  committed
  b384ff0

• Update save.py

  danielhanchen

  committed
  a8b5d89

• Update save.py

  danielhanchen

  committed
  872d569

• Update save.py

  danielhanchen

  committed
  3a1f5f2

Commits on Jun 2, 2024

• Update save.py

  danielhanchen

  committed
  bcadc8c

• remove_special_tokens

  danielhanchen

  committed
  1381820

• Ollama

  danielhanchen

  committed
  e01b87d

Commits on Jun 3, 2024

• Update chat_templates.py

  danielhanchen

  committed
  b3479c7

• Update chat_templates.py

  danielhanchen

  committed
  86804dc

• Update chat_templates.py

  danielhanchen

  committed
  87fdd3a

Commits on Jun 7, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  5c5df69

• Update llama.py

  danielhanchen

  committed
  6386d94

Commits on Jun 9, 2024

• Update chat_templates.py

  danielhanchen

  committed
  b1a9551

• Support bfloat16 GGUF

  danielhanchen

  committed
  344a05d

• Update save.py

  danielhanchen

  committed
  6b11e0d

• Update llama.py

  danielhanchen

  committed
  c6e4b5b

• fast_forward_inference

  danielhanchen

  committed
  57f29ab

• Update mapper.py

  danielhanchen

  committed
  d32e972

• Update loader.py

  danielhanchen

  committed
  e121fa5

• Update llama.py

  danielhanchen

  committed
  5eaa10f

Commits on Jun 10, 2024

• Update tokenizer_utils.py

  danielhanchen

  committed
  f57d28d

Commits on Jun 11, 2024

• info

  danielhanchen

  committed
  8937507

• edits

  danielhanchen

  committed
  8982edb

• Create chat template

  danielhanchen

  committed
  8904605

Commits on Jun 12, 2024

• Fix tokenizer

  danielhanchen

  committed
  2a374c2

Commits on Jun 13, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  d704b73

• Update tokenizer_utils.py

  danielhanchen

  committed
  8176155

• fix case where gguf saving fails due to first_conversion dtype (#630)

  chrehall68

  authored
  21a99f1

• Support revision parameter in FastLanguageModel.from_pretrained (#629)

  Show description for dbf2dcf
  chrehall68

  authored
  dbf2dcf

• clears any selected_adapters before calling internal_model.save_pretrained (#609)

  neph1

  authored
  9016171

• Update __init__.py (#602)

  Show description for 0428920
  xyangk

  authored
  0428920

• Fixed unsloth/tokenizer_utils.py for chat training (#604)

  Oseltamivir

  authored
  9fdd847

• Add GGML saving option to Unsloth for easier Ollama model creation and testing. (#345)

  Show description for b5fc6aa
  mahiatlinux

  authored
  b5fc6aa

• docs: Add LoraConfig parameters documentation (#619)

  sebdg

  authored
  3fafbf7

• llama.cpp failing (#371)

  Show description for 273a871
  

  bet0x

  and

  danielhanchen

  authored
  273a871

• fix libcuda_dirs import for triton 3.0 (#227)

  Show description for b312b3f
  

  t-vi

  and

  danielhanchen

  authored
  b312b3f

• Update save.py

  danielhanchen

  committed
  1601dca

• Update __init__.py

  danielhanchen

  committed
  26dc502

• Update fast_lora.py

  danielhanchen

  committed
  6a51657

• Update save.py

  danielhanchen

  committed
  4a8ba90

• Update save.py

  danielhanchen

  committed
  0abb5ba

• Update save.py

  danielhanchen

  committed
  b24dd05

• Update loader.py

  danielhanchen

  committed
  48c6d6d

• Update save.py

  danielhanchen

  committed
  e35f608

• Update save.py

  danielhanchen

  committed
  4822eae

• quantize now llama-quantize

  danielhanchen

  committed
  7d847ed

• Update chat_templates.py

  danielhanchen

  committed
  82f10cb

• Update loader.py

  danielhanchen

  committed
  08424f0

• Update mapper.py

  danielhanchen

  committed
  eb906d0

• Update __init__.py

  danielhanchen

  committed
  0a304ae

• embedding size

  danielhanchen

  committed
  71edc42

• Merge branch 'main' into nightly

  danielhanchen

  committed
  411b881

• Update qwen2.py

  danielhanchen

  committed
  b74e321

Commits on Jun 14, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  9c6d415

• docs

  danielhanchen

  committed
  b82277f

• Update README.md

  danielhanchen

  committed
  d98e45e

• Update qwen2.py

  danielhanchen

  committed
  b6f0fdb

• README: Fix minor typo. (#559)

  Show description for 6c031e4
  

  shaper

  and

  danielhanchen

  authored
  6c031e4

• Update mistral.py

  danielhanchen

  committed
  2401dee

• Update qwen2.py

  danielhanchen

  committed
  1b93d7e

• Update qwen2.py

  danielhanchen

  committed
  3581037

• Update qwen2.py

  danielhanchen

  committed
  b56b8b8

• Update llama.py

  danielhanchen

  committed
  fe8c064

• Update llama.py

  danielhanchen

  committed
  d8d332a

• Update llama.py

  danielhanchen

  committed
  cdb1dbb

• Update README.md

  danielhanchen

  committed
  e8b3cf0

• FastMistralModel

  danielhanchen

  committed
  7e6f000

• Update mistral.py

  danielhanchen

  committed
  28995ab

• Update mistral.py

  danielhanchen

  committed
  515b1ae

• Update mistral.py

  danielhanchen

  committed
  7f28209

• Update mistral.py

  danielhanchen

  committed
  453cc48

• Update mistral.py

  danielhanchen

  committed
  6633d4a

• Auto check rope scaling

  danielhanchen

  committed
  e5bf125

• Merge branch 'main' into nightly

  danielhanchen

  committed
  d4f4bce

• Update llama.py

  danielhanchen

  committed
  341565b

Commits on Jun 15, 2024

• Update llama.py

  danielhanchen

  committed
  dd3c6b1

• Update llama.py

  danielhanchen

  committed
  6d1ae23

• GPU support

  danielhanchen

  committed
  d855ef9

• Merge branch 'main' into nightly

  danielhanchen

  committed
  da1fe76

• Typo

  danielhanchen

  committed
  6656446

• Update gemma.py

  danielhanchen

  committed
  9bd5fad

• gpu

  danielhanchen

  committed
  a3061b6

• Merge branch 'main' into nightly

  danielhanchen

  committed
  7e5155d

• Multiple GGUF saving

  danielhanchen

  committed
  513bd4d

• Update save.py

  danielhanchen

  committed
  fb54fbb

• Update save.py

  danielhanchen

  committed
  4cba3e2

• Merge branch 'main' into nightly

  danielhanchen

  committed
  979bb22

• check PEFT and base

  danielhanchen

  committed
  31811cf

• Update llama.py

  danielhanchen

  committed
  a0232a7

• Update llama.py

  danielhanchen

  committed
  c4c4ff4

• Update llama.py

  danielhanchen

  committed
  80e82a2

• Update llama.py

  danielhanchen

  committed
  f62237d

• Update llama.py

  danielhanchen

  committed
  7f864dc

• Update chat_templates.py

  danielhanchen

  committed
  4dda039

Commits on Jun 16, 2024

• Fix breaking bug in save.py with interpreting quantization_method as a string when saving to gguf (#651)

  Show description for 30605de
  

  12 peopleauthored
  30605de

• Merge branch 'main' into nightly

  danielhanchen

  committed
  1ba18ac

• Revert "Fix breaking bug in save.py with interpreting quantization_method as …" (#652)

  Show description for e2b2083
  danielhanchen

  authored
  e2b2083

• Merge branch 'nightly' of https://github.com/unslothai/unsloth into nightly

  danielhanchen

  committed
  aeda849

• Revert "Revert "Fix breaking bug in save.py with interpreting quantization_me…" (#653)

  Show description for 0938ab8
  danielhanchen

  authored
  0938ab8

• Merge branch 'main' into nightly

  danielhanchen

  committed
  46517a9

• Update llama.py

  danielhanchen

  committed
  99f0397

• peft

  danielhanchen

  committed
  b824627

• patch

  danielhanchen

  committed
  e4f2263

• Update loader.py

  danielhanchen

  committed
  7aadceb

• retrain

  danielhanchen

  committed
  17a9fb3

• Update llama.py

  danielhanchen

  committed
  25cb17e

• Update llama.py

  danielhanchen

  committed
  3fba0f5

• Update llama.py

  danielhanchen

  committed
  798aa1e

• Update llama.py

  danielhanchen

  committed
  c6142d0

• Update llama.py

  danielhanchen

  committed
  7236dfc

• Update llama.py

  danielhanchen

  committed
  37f9abd

• Update llama.py

  danielhanchen

  committed
  7618197

• Update llama.py

  danielhanchen

  committed
  b4907f3

• Update llama.py

  danielhanchen

  committed
  2714a8b

• Update llama.py

  danielhanchen

  committed
  771a0d0

Commits on Jun 17, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  af88eda

• offload

  danielhanchen

  committed
  92c7d58

• Update llama.py

  danielhanchen

  committed
  2eacd2d

Commits on Jun 18, 2024

• Create a starter script for command-line training to integrate in ML ops pipelines. (#623)

  sebdg

  authored
  b957061

• Update chat_templates.py

  danielhanchen

  committed
  4dba6c5

• Ollama

  danielhanchen

  committed
  f2e4b83

• Update chat_templates.py

  danielhanchen

  committed
  a5367a1

• Update chat_templates.py

  danielhanchen

  committed
  85062ff

• Update chat_templates.py

  danielhanchen

  committed
  12bd3cf

• Update chat_templates.py

  danielhanchen

  committed
  4417417

• Update chat_templates.py

  danielhanchen

  committed
  be02d97

• Update chat_templates.py

  danielhanchen

  committed
  0a1ee7a

• Update chat_templates.py

  danielhanchen

  committed
  7195152

• Update chat_templates.py

  danielhanchen

  committed
  676b20b

• Update chat_templates.py

  danielhanchen

  committed
  89b7807

• Update chat_templates.py

  danielhanchen

  committed
  563afa9

Commits on Jun 19, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  7bcaa23

• Ollama

  danielhanchen

  committed
  bbfa77c

• Update chat_templates.py

  danielhanchen

  committed
  9a88ac1

• ollama

  danielhanchen

  committed
  89e3027

• Update mapper.py

  danielhanchen

  committed
  412a7c9

• Update chat_templates.py

  danielhanchen

  committed
  44039e5

• Update save.py

  danielhanchen

  committed
  fc9ec40

• Update save.py

  danielhanchen

  committed
  7be6d88

• Update save.py

  danielhanchen

  committed
  5530710

• Update save.py

  danielhanchen

  committed
  d5b8d41

• Update save.py

  danielhanchen

  committed
  d1b3fac

• Update save.py

  danielhanchen

  committed
  99b68ff

• Update save.py

  danielhanchen

  committed
  a25dea9

Commits on Jun 20, 2024

• Merge branch 'main' into nightly

  danielhanchen

  committed
  bee81d1

• Update chat_templates.py

  danielhanchen

  committed
  e544c97

• Update chat_templates.py

  danielhanchen

  committed
  3f27de2

• Update chat_templates.py

  danielhanchen

  committed
  34c71b5

• Update chat_templates.py

  danielhanchen

  committed
  ae2924f

• Merge branch 'main' into nightly

  danielhanchen

  committed
  15e4e10

• Update llama.py

  danielhanchen

  committed
  a5cbf3e

• Fixes

  danielhanchen

  committed
  b5888ba