Skip to content

Commit

Permalink
Update Moe dataset download instructions
Browse files Browse the repository at this point in the history
  • Loading branch information
pgmpablo157321 committed Oct 29, 2024
1 parent 0cde977 commit 86a25ad
Showing 1 changed file with 3 additions and 4 deletions.
7 changes: 3 additions & 4 deletions language/mixtral-8x7b/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -104,24 +104,23 @@ sudo -v ; curl https://rclone.org/install.sh | sudo bash
```
Once Rclone is installed, cd into the folder where you want to place the dataset and run:
```bash
rclone copyurl https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl ./ -a -P
rclone copyurl https://inference.mlcommons-storage.org/09292024_mixtral_15k_mintoken2_v1.pkl ./ -a -P
```
#### Using wget

Alternatively, you can simply cd into the folder where you want to place the dataset and run

TBD: The dataset is being replaced in v5.0 due to https://github.com/mlcommons/inference/issues/1777

```bash
wget https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_v4.pkl
wget https://inference.mlcommons-storage.org/mixtral_8x7b/09292024_mixtral_15k_mintoken2_v1.pkl
```

### Calibration dataset

#### Using Rclone
Rclone is installed, cd into the folder where you want to place the dataset and run:
```bash
rclone copyurl https://inference.mlcommons-storage.org/mixtral_8x7b%2F2024.06.06_mixtral_15k_calibration_v4.pkl ./ -a -P
rclone copyurl https://inference.mlcommons-storage.org/mixtral_8x7b/mixtral_8x7b%2F2024.06.06_mixtral_15k_calibration_v4.pkl ./ -a -P
```

#### Using wget
Expand Down

0 comments on commit 86a25ad

Please sign in to comment.