Skip to content

Commit 4495fc6

Browse files
zouyida2002z00897138
andauthored
bugfix for mrope (vllm-project#14)
a fix follow up [MRotaryEmbedding change](vllm-project@bf3b79e#diff-6bc44986c91bf0876240dec03d56c748403691c7fcd90f7a22e7affff7b033ecR839) Signed-off-by: z00897138 <zhaorifa@huawei.com> Co-authored-by: z00897138 <zhaorifa@huawei.com>
1 parent 7d9ae22 commit 4495fc6

File tree

1 file changed

+2
-6
lines changed

1 file changed

+2
-6
lines changed

vllm_ascend/model_runner.py

Lines changed: 2 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -749,14 +749,10 @@ def _compute_multi_modal_input(self, inter_data: InterDataForSeqGroup,
749749
mrope_input_positions, mrope_position_delta = \
750750
MRotaryEmbedding.get_input_positions(
751751
token_ids,
752+
hf_config,
752753
image_grid_thw=image_grid_thw,
753754
video_grid_thw=video_grid_thw,
754-
image_token_id=hf_config.image_token_id,
755-
video_token_id=hf_config.video_token_id,
756-
vision_start_token_id=hf_config.vision_start_token_id,
757-
vision_end_token_id=hf_config.vision_end_token_id,
758-
spatial_merge_size=hf_config.vision_config.
759-
spatial_merge_size,
755+
second_per_grid_ts=None,
760756
context_len=inter_data.context_lens[seq_idx],
761757
seq_len=inter_data.seq_lens[seq_idx],
762758
)

0 commit comments

Comments
 (0)