We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 5e0aea4 commit a26c097Copy full SHA for a26c097
vllm_ascend/worker/model_runner_v1.py
@@ -1957,6 +1957,7 @@ def execute_model(
1957
1958
# Apply structured output bitmasks if present
1959
if scheduler_output.grammar_bitmask is not None:
1960
+ assert logits is not None
1961
# NOTE:
1962
# 1. XGrammar bitmask applying only supports CPU and GPU.
1963
# 2. The logits and bitmask should be on the same device.
0 commit comments