Skip to content

Commit dd425d6

Browse files
authored
[Platform] add dispatch key (#17)
### What this PR does / why we need it? Add dispatch key for NPU, so that the log could be print correctly. Now ``` executor_base.py:110] # CPU blocks: 220478, # CPU blocks: 21845 ``` After this pr ``` executor_base.py:110] # NPU blocks: 220478, # CPU blocks: 21845 ``` ### Does this PR introduce _any_ user-facing change? N/A ### How was this patch tested? CI passed and log printed as above Signed-off-by: MengqingCao <cmq0113@163.com>
1 parent 5f46501 commit dd425d6

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm_ascend/platform.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,6 +57,7 @@ class NPUPlatform(Platform):
5757
simple_compile_backend: str = "npu"
5858
ray_device_key: str = "NPU"
5959
device_control_env_var: str = "ASCEND_RT_VISIBLE_DEVICES"
60+
dispatch_key: str = "PrivateUse1"
6061

6162
supported_quantization: list[str] = ["ascend"]
6263

0 commit comments

Comments
 (0)