Skip to content

Commit 6038128

Browse files
author
zhouyu5
committed
fix format
Signed-off-by: zhouyu5 <yu.zhou@intel.com>
1 parent 663618c commit 6038128

File tree

1 file changed

+3
-2
lines changed

1 file changed

+3
-2
lines changed

vllm/model_executor/guided_decoding/outlines_logits_processors.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -29,6 +29,7 @@
2929
from outlines_core.fsm.json_schema import build_regex_from_schema
3030
from pydantic import BaseModel
3131
from transformers import PreTrainedTokenizerBase
32+
3233
from vllm.platforms import current_platform
3334

3435

@@ -91,8 +92,8 @@ def __call__(self, input_ids: List[int],
9192
allowed_tokens < scores.shape[-1])
9293
mask.index_fill_(0, allowed_tokens, 0)
9394
if current_platform.is_hpu():
94-
# Workaround for HPU bug where add_() raise RuntimeError:
95-
# synNodeCreateWithId failed for node: strided_insert
95+
# Workaround for HPU bug where add_() raise RuntimeError:
96+
# synNodeCreateWithId failed for node: strided_insert
9697
# with synStatus 1 [Invalid argument], hopefully it will
9798
# be fixed in the future releases of the HPU runtime.
9899
scores = scores.add(mask)

0 commit comments

Comments
 (0)