Skip to content

Commit a57f7e7

Browse files
MengqingCaoYikun
authored andcommitted
add custom scheduler guide and performance env
Signed-off-by: MengqingCao <cmq0113@163.com> Signed-off-by: Yikun Jiang <yikunkero@gmail.com>
1 parent 8dd451c commit a57f7e7

File tree

6 files changed

+10
-4
lines changed

6 files changed

+10
-4
lines changed

docs/requirements-docs.txt

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -7,3 +7,4 @@ sphinx-togglebutton
77
myst-parser
88
msgspec
99
sphinx-substitution-extensions
10+
snowballstemmer<3.0.0

docs/source/quick_start.md

Lines changed: 5 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -139,4 +139,8 @@ INFO: Application shutdown complete.
139139

140140
Finally, you can exit container by using `ctrl-D`.
141141
::::
142-
:::::
142+
:::::
143+
144+
### Performance enhancement related environment variables in Mindie Turbo
145+
146+
Currently, some performance enhancement features in MindIE Turbo have certain scenario restrictions. For these features, environment variables are used to control whether to enable them. For related environment variables, see its [official documentation](https://www.hiascend.com/document/detail/zh/mindie/20RC1/AcceleratePlugin/turbodev/mindie-turbo-0010.html).

docs/source/user_guide/suppoted_features.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,3 +35,4 @@ MindIE Turbo is an optional performace optimization plugin. Find more informatio
3535
| Graph Mode | 🟡 Planned | 🟡 Planned | Will support in v0.8.x |
3636
| Sleep Mode | 🟢 Functional | 🟢 Functional | [Usage Limits][#733](https://github.com/vllm-project/vllm-ascend/issues/733) |
3737
| MTP | 🟢 Functional | 🟢 Functional | [Usage Limits][#734](https://github.com/vllm-project/vllm-ascend/issues/734) |
38+
| Custom Scheduler | 🟢 Functional | 🟢 Functional | [Usage Limits][#788](https://github.com/vllm-project/vllm-ascend/issues/788) |

vllm_ascend/utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -32,4 +32,4 @@ def try_register_lib(lib_name: str,
3232
if lib_info:
3333
logger.info(lib_info)
3434
except Exception:
35-
logger.warning_once(exception_info)
35+
logger.info_once(exception_info)

vllm_ascend/worker/worker.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,7 @@ def __init__(
7878
try_register_lib(
7979
"mindie_turbo",
8080
"MindIE Turbo is installed. vLLM inference will be accelerated with MindIE Turbo.",
81-
"MindIE Turbo not found, please check the installation of mindie-turbo if you attempt to use it."
81+
"MindIE Turbo not found or unable to `import mindie_turbo`, skip MindIE Turbo acceleration."
8282
)
8383
# distribute related config
8484
self.parallel_config.rank = rank

vllm_ascend/worker/worker_v1.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -78,7 +78,7 @@ def __init__(self,
7878
try_register_lib(
7979
"mindie_turbo",
8080
"MindIE Turbo is installed. vLLM inference will be accelerated with MindIE Turbo.",
81-
"MindIE Turbo not found, please check the installation of mindie-turbo if you attempt to use it."
81+
"MindIE Turbo not found or unable to `import mindie_turbo`, skip MindIE Turbo acceleration."
8282
)
8383

8484
if self.cache_config.cache_dtype == "auto":

0 commit comments

Comments
 (0)