Skip to content

Commit b1c6d0b

Browse files
committed
[Model] Integrate PARD into vLLM
Signed-off-by: root <anzihao_hh@126.com>
1 parent 2efeac5 commit b1c6d0b

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/spec_decode/multi_step_worker.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -107,7 +107,7 @@ def sampler_output(
107107
self.worker.model_runner.return_hidden_states = True
108108

109109
if hasattr(self, "pard") and self.pard is True:
110-
filtered_model_outputs = self.pard_infer(execute_model_req, sample_len)
110+
filtered_model_outputs = self.pard_infer(expanded_request, sample_len)
111111
return filtered_model_outputs, True
112112

113113
for _ in range(sample_len):

0 commit comments

Comments
 (0)