From 8253efeb9a5283cb368893f105be3700f6ba0920 Mon Sep 17 00:00:00 2001 From: Daniel Han Date: Thu, 20 Nov 2025 07:51:37 -0800 Subject: [PATCH] Add Unsloth exporting to GGUF in tools --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 29627835853..cff3bd4370e 100644 --- a/README.md +++ b/README.md @@ -242,6 +242,7 @@ Instructions for adding support for new models: [HOWTO-add-model.md](docs/develo - [crashr/gppm](https://github.com/crashr/gppm) – launch llama.cpp instances utilizing NVIDIA Tesla P40 or P100 GPUs with reduced idle power consumption - [gpustack/gguf-parser](https://github.com/gpustack/gguf-parser-go/tree/main/cmd/gguf-parser) - review/check the GGUF file and estimate the memory usage - [Styled Lines](https://marketplace.unity.com/packages/tools/generative-ai/styled-lines-llama-cpp-model-292902) (proprietary licensed, async wrapper of inference part for game development in Unity3d with pre-built Mobile and Web platform wrappers and a model example) +- [unslothai/unsloth](https://github.com/unslothai/unsloth) – 🦥 exports/saves fine-tuned and trained models to GGUF (Apache-2.0)