Skip to content

Commit

Permalink
release: version 0.2.1
Browse files Browse the repository at this point in the history
  • Loading branch information
chenhunghan committed Jan 10, 2024
1 parent cd45ef2 commit e9631e3
Show file tree
Hide file tree
Showing 3 changed files with 32 additions and 4 deletions.
2 changes: 1 addition & 1 deletion Cargo.lock

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

4 changes: 2 additions & 2 deletions Cargo.toml
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[package]
name = "mlx-training-rs"
version = "0.2.0"
version = "0.2.1"
edition = "2021"
repository = "https://github.com/chenhunghan/mlx-training-rs"

Expand Down Expand Up @@ -36,7 +36,7 @@ installers = ["shell", "homebrew"]
# A GitHub repo to push Homebrew formulas to
tap = "chenhunghan/homebrew-formulae"
# Target platforms to build apps for (Rust target-triple syntax)
targets = ["x86_64-unknown-linux-gnu", "aarch64-apple-darwin", "x86_64-apple-darwin", "x86_64-pc-windows-msvc"]
targets = ["aarch64-apple-darwin", "x86_64-apple-darwin"]
# Publish jobs to run in CI
publish-jobs = ["homebrew"]
# Publish jobs to run in CI
Expand Down
30 changes: 29 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,34 @@
# mlx-training-rs

Rusty scripts to generate __synthetic__ data for MLX traning.
A CLI to generate __synthetic__ data for MLX traning. The CLI is largely translated from the php version [here](https://apeatling.com/articles/simple-guide-to-local-llm-fine-tuning-on-a-mac-with-mlx/?utm_source=pocket_reader).

## Fine-Tuning LLM for Dummy on Apple Silicon

Based on [this](https://apeatling.com/articles/simple-guide-to-local-llm-fine-tuning-on-a-mac-with-mlx/?utm_source=pocket_reader), [this](https://www.reddit.com/r/LocalLLaMA/comments/191s7x3/a_simple_guide_to_local_llm_finetuning_on_a_mac/?share_id=hH4Vu8gxZgwYRvl_fIyOu&utm_content=1&utm_medium=ios_app&utm_name=ioscss&utm_source=share&utm_term=1), [this](https://www.reddit.com/r/LocalLLaMA/comments/18ujt0n/using_gpus_on_a_mac_m2_max_via_mlx_update_on/) and [this](https://www.reddit.com/r/LocalLLaMA/comments/18wabkc/lessons_learned_so_far_lora_fine_tuning_on/).

### Install HomeBrew

```shell
/bin/bash -c "$(curl -fsSL https://raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)"
```

### Setting up Python3

```shell
brew install python@3.11
```

### Download MLX and the Model to Fine-tuning

Clone MLX
```sh
git clone https://github.com/ml-explore/mlx-examples.git
```


```sh
python convert.py --hf-path mistralai/Mistral-7B-Instruct-v0.2 -q --mlx-path ./Mistral-7B-Instruct-v0.2-mlx-4bit

```

## Get started

Expand Down

0 comments on commit e9631e3

Please sign in to comment.