Skip to content

Commit 65f2de5

Browse files
authored
fix: Fix sample disagg config for trtllm standalone (#1566)
1 parent ac4fd87 commit 65f2de5

File tree

1 file changed

+1
-0
lines changed
  • launch/dynamo-run/src/subprocess/trtllm_config

1 file changed

+1
-0
lines changed

launch/dynamo-run/src/subprocess/trtllm_config/sample.yaml

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -20,5 +20,6 @@
2020
# You might have to tweak this config based on your model size and GPU memory.
2121

2222
backend: pytorch
23+
disable_overlap_scheduler: true
2324
kv_cache_config:
2425
free_gpu_memory_fraction: 0.40

0 commit comments

Comments
 (0)