Skip to content

Commit d83633b

Browse files
authored
chore: Default to pytorch backend in trtllm worker (#1445)
1 parent 75d7c3b commit d83633b

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

launch/dynamo-run/src/subprocess/trtllm_inc.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -352,6 +352,7 @@ async def init(runtime: DistributedRuntime, config: Config):
352352
arg_map = {
353353
"model": model_path,
354354
"tensor_parallel_size": config.tensor_parallel_size,
355+
"backend": "pytorch",
355356
"skip_tokenizer_init": True,
356357
"disable_log_requests": True,
357358
"enable_prefix_caching": True,

0 commit comments

Comments
 (0)