Skip to content

Commit

Permalink
document that packaging needs to be installed before flash-attn
Browse files Browse the repository at this point in the history
  • Loading branch information
winglian committed Sep 12, 2023
1 parent 772cd87 commit 15aebb2
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -71,6 +71,7 @@ Get started with Axolotl in just a few steps! This quickstart guide will walk yo
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl

pip3 install packaging
pip3 install -e .[flash-attn]
pip3 install -U git+https://github.com/huggingface/peft.git

Expand Down Expand Up @@ -105,6 +106,7 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \

3. Install axolotl along with python dependencies
```bash
pip3 install packaging
pip3 install -e .[flash-attn]
```

Expand Down Expand Up @@ -140,7 +142,8 @@ accelerate launch scripts/finetune.py examples/openllama-3b/lora.yml \
git clone https://github.com/OpenAccess-AI-Collective/axolotl
cd axolotl
pip3 install -e .
pip3 install packaging
pip3 install -e .[flash-attn]
pip3 install protobuf==3.20.3
pip3 install -U --ignore-installed requests Pillow psutil scipy
```
Expand Down

0 comments on commit 15aebb2

Please sign in to comment.