You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@@ -138,16 +113,6 @@ Use the default pre-built image and inject custom configurations via PVC:
138
113
139
114
> **Note**: All paths must start with `/data/` for security reasons. If you forget this prefix, the script will show a helpful error message with the correct path.
140
115
141
-
3.**Set the config path for the profiling job:**
142
-
```bash
143
-
export DGD_CONFIG_FILE=/workspace/profiling_results/disagg.yaml # or your custom path
144
-
```
145
-
146
-
This approach allows you to:
147
-
- Customize DGD configurations without rebuilding container images
148
-
- Test different model configurations easily
149
-
- Version control your DGD configs alongside your code
150
-
151
116
> **Important**: For profiling, disagg configs should be run with Grove disabled by adding the annotation `nvidia.com/enable-grove: "false"` to avoid alpha Grove status issues.
152
117
153
118
**Step 2: Set SLA target**
@@ -173,13 +138,25 @@ spec:
173
138
- <vllm/sglang>
174
139
```
175
140
176
-
**Step 3: Run profiling (required)**
141
+
**Step 3: Define the container image and config path**
142
+
143
+
1. **Set the container image:**
144
+
```bash
145
+
export DOCKER_IMAGE=nvcr.io/nvidia/ai-dynamo/vllm-runtime:0.4.1 # or any existing image tag (TODO: update to 0.5.0 upon release as profiling with 0.4.1 is broken)
146
+
```
147
+
148
+
3.**Set the config path for the profiling job:**
149
+
```bash
150
+
export DGD_CONFIG_FILE=/data/configs/disagg.yaml # should be the same path you set for --dest in Step 1
0 commit comments