Skip to content

Commit 7431045

Browse files
authored
Merge pull request #382 from ryan-lempka/rlempka/enable-embedding-model-for-tutorial
fix: add embedding model as customization target
2 parents 749bab7 + 8852a81 commit 7431045

File tree

1 file changed

+14
-0
lines changed
  • nemo/data-flywheel/embedding-finetuning

1 file changed

+14
-0
lines changed

nemo/data-flywheel/embedding-finetuning/README.md

Lines changed: 14 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -47,6 +47,20 @@ Refer to the [platform prerequisites and installation guide](https://docs.nvidia
4747

4848
> **NOTE:** Fine-tuning for embedding models is supported starting with NeMo Microservices version 25.8.0. Please ensure you deploy NeMo Microservices Helm chart version 25.8.0 or later to use these notebooks.
4949
50+
### Register the Base Model
51+
52+
After deploying NeMo Microservices, register the `llama-3.2-nv-embedqa-1b-v2` base model with NeMo Customizer:
53+
54+
```bash
55+
helm upgrade nemo nmp/nemo-microservices-helm-chart --namespace default --reuse-values \
56+
--set customizer.customizationTargets.overrideExistingTargets=false \
57+
--set 'customizer.customizationTargets.targets.nvidia/llama-3\.2-nv-embedqa-1b@v2.enabled=true' && \
58+
kubectl delete pod -n default -l app.kubernetes.io/name=nemo-customizer && \
59+
kubectl wait --for=condition=ready pod -l app.kubernetes.io/name=nemo-customizer -n default --timeout=5m
60+
```
61+
62+
This restarts the customizer to register the model (~2-3 minutes). The base checkpoint downloads from NGC on first use.
63+
5064
### Client-Side Requirements
5165

5266
Ensure you have access to:

0 commit comments

Comments
 (0)