Skip to content

Commit 3bf4a95

Browse files
PicoCreatoramd-xiaoyu12
authored andcommitted
[BugFix] Fix logits repetition penalty cuda check (vllm-project#22592)
Signed-off-by: Xiao Yu <xiao.yu@amd.com>
1 parent 2a42d65 commit 3bf4a95

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/_custom_ops.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -312,7 +312,7 @@ def apply_repetition_penalties(logits: torch.Tensor, prompt_mask: torch.Tensor,
312312
output_mask: A boolean tensor indicating which tokens appear in the output.
313313
repetition_penalties: The repetition penalties of shape (num_seqs, ).
314314
"""
315-
if current_platform.is_cuda() and logits.is_contiguous():
315+
if logits.is_cuda and logits.is_contiguous():
316316
apply_repetition_penalties_cuda(logits, prompt_mask, output_mask,
317317
repetition_penalties)
318318
else:

0 commit comments

Comments
 (0)