Commit fc1c397

committed

feat: optimize mrope pos calculation perf

Signed-off-by: imkero <kerorek@outlook.com>

1 parent d92879b commit fc1c397Copy full SHA for fc1c397

6 files changed

+1476

-511

lines changed

tests/model_executor
- test_mrope_positions.py
vllm
- model_executor/layers
  - mrope_positions.py
  - rotary_embedding.py
- v1/worker
  - gpu_model_runner.py
- worker
  - cpu_model_runner.py
  - model_runner.py

6 files changed

+1476

-511

lines changed

Comments

(0)