Skip to content

Commit 24b5e12

Browse files
tdoublepxuebwang-amd
authored andcommitted
Change size of single CUDA graph for CI to 4 (vllm-project#26089)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com> Signed-off-by: xuebwang-amd <xuebwang@amd.com>
1 parent c2a0ee6 commit 24b5e12

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

tests/conftest.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -732,7 +732,7 @@ def __init__(
732732
set_default_torch_num_threads(default_torch_num_threads))
733733

734734
if not kwargs.get("compilation_config", None):
735-
kwargs["compilation_config"] = {"cudagraph_capture_sizes": [8]}
735+
kwargs["compilation_config"] = {"cudagraph_capture_sizes": [4]}
736736

737737
with init_ctx:
738738
self.llm = LLM(

0 commit comments

Comments
 (0)