Skip to content

Commit 440ca48

Browse files
committed
update qat readme
Signed-off-by: Jennifer Chen <jennifchen@nvidia.com>
1 parent 2664563 commit 440ca48

File tree

1 file changed

+7
-5
lines changed

1 file changed

+7
-5
lines changed

examples/nemo_run/qat/README.md

Lines changed: 7 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -56,18 +56,20 @@ The resulting exported checkpoint also is much smaller in memory at 6.4GB compar
5656

5757
You can run the example either locally or on a [Slurm cluster](ADVANCED.md).
5858

59-
To run the example locally, launch a [NeMo container](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo) with version 25.09 or higher. Clone the `TensorRT-Model-Optimizer` repository and `NeMo` repository (checkout a specific commit for NeMo), then mount it onto your docker container.
59+
To run the example locally, first clone the `TensorRT-Model-Optimizer` repository, then mount the repository to a [NeMo container](https://catalog.ngc.nvidia.com/orgs/nvidia/containers/nemo) with version 25.09. Make sure to also set your HuggingFace token for dataset/model downloading.
60+
61+
Set up repo & HuggingFace token:
6062

6163
- `git clone https://github.com/NVIDIA/TensorRT-Model-Optimizer.git`
62-
- `git clone https://github.com/NVIDIA/Megatron-LM.git`
64+
- `export HF_TOKEN=<your-token>`
6365

64-
Example docker command:
66+
Run docker command:
6567

6668
```bash
67-
docker run -v /home/user/:/home/user/ -v /home/user/TensorRT-Model-Optimizer/modelopt/:/usr/local/lib/python3.12/dist-packages/modelopt -v /home/user/Megatron-LM:/opt/megatron-lm --gpus all -it --shm-size 20g --rm nvcr.io/nvidia/nemo:25.09 bash
69+
docker run -v /home/user/:/home/user/ -v /home/user/TensorRT-Model-Optimizer/:/opt/TensorRT-Model-Optimizer/ --gpus all -it --shm-size 20g --rm nvcr.io/nvidia/nemo:25.09 bash
6870
```
6971

70-
You will also need to set your Huggingface token with `export HF_TOKEN=<your-token>`. You may also need to enable write access to the docker container to the `examples/nemo_run` folder by doing `chmod 777 nemo_run` so that logs can be written.
72+
You may also need to enable write access to the docker container to the `examples/nemo_run` folder by doing `chmod 777 nemo_run` so that logs can be written.
7173

7274
### Running the Flow Locally
7375

0 commit comments

Comments
 (0)