Skip to content

Commit 11c5e81

Browse files
committed
[Doc] pin the version of vllm-ascend that stable running 310I Duo to v0.10.0.rc1
Signed-off-by: leo-pony <nengjunma@outlook.com>
1 parent 19b85ef commit 11c5e81

File tree

2 files changed

+3
-2
lines changed

2 files changed

+3
-2
lines changed

docs/source/faqs.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ Currently, **ONLY** Atlas A2 series(Ascend-cann-kernels-910b),Atlas A3 series(
1515
- Atlas 800I A2 Inference series (Atlas 800I A2)
1616
- Atlas A3 Training series (Atlas 800T A3, Atlas 900 A3 SuperPoD, Atlas 9000 A3 SuperPoD)
1717
- Atlas 800I A3 Inference series (Atlas 800I A3)
18-
- [Experimental] Atlas 300I Inference series (Atlas 300I Duo)
18+
- [Experimental] Atlas 300I Inference series (Atlas 300I Duo). Currently for 310I Duo the stable version is vllm-ascend v0.10.0rc1.
1919

2020
Below series are NOT supported yet:
2121
- Atlas 200I A2 (Ascend-cann-kernels-310b) unplanned yet

docs/source/tutorials/single_node_300i.md

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3,6 +3,7 @@
33
```{note}
44
1. This Atlas 300I series is currently experimental. In future versions, there may be behavioral changes around model coverage, performance improvement.
55
2. Currently, the 310I series only supports eager mode and the data type is float16.
6+
3. The latest version has a large number of PRs for new features and models that need to be merged urgently. However, these PRs are not compatible with the 310I Duo, causing support for the 310I Duo in the main branch in breaking state. This issue is still in fixing. The current stable version for 310I Duo is vllm-ascend v0.10.0rc1.
67
```
78

89
## Run vLLM on Altlas 300I series
@@ -12,7 +13,7 @@ Run docker container:
1213
```{code-block} bash
1314
:substitutions:
1415
# Update the vllm-ascend image
15-
export IMAGE=quay.io/ascend/vllm-ascend:|vllm_ascend_version|-310p
16+
export IMAGE=quay.io/ascend/vllm-ascend:v0.10.0rc1-310p
1617
docker run --rm \
1718
--name vllm-ascend \
1819
--device /dev/davinci0 \

0 commit comments

Comments
 (0)