Skip to content

Commit 1ad2cd4

Browse files
EcthlionYuqi Zhang
authored andcommitted
Fix broken example: examples/offline_inference/profiling at scheduler_config (vllm-project#18117)
Signed-off-by: Yuqi Zhang <yuqizhang@google.com>
1 parent c597aba commit 1ad2cd4

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/offline_inference/profiling.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -193,7 +193,7 @@ def run_profile(context: ProfileContext, csv_output: Optional[str],
193193
batch_size = context.batch_size
194194
prompt_len = context.prompt_len
195195

196-
scheduler_config = llm.llm_engine.scheduler_config
196+
scheduler_config = llm.llm_engine.vllm_config.scheduler_config
197197
max_model_len = llm.llm_engine.model_config.max_model_len
198198
max_num_batched_tokens = scheduler_config.max_num_batched_tokens
199199
max_num_seqs = scheduler_config.max_num_seqs

0 commit comments

Comments
 (0)