You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If you want to use container image for offline environments (no internet connection), you need to download container image in a environment with internet access:
41
+
42
+
**Exporting Docker images:**
43
+
44
+
```{code-block} bash
45
+
:substitutions:
46
+
# Pull the image on a machine with internet access
47
+
TAG=|vllm_ascend_version|
48
+
docker pull quay.io/ascend/vllm-ascend:$TAG
49
+
50
+
# Export the image to a tar file
51
+
docker save quay.io/ascend/vllm-ascend:$TAG -o vllm-ascend-$TAG.tar
52
+
53
+
# Optional: Compress to reduce file size
54
+
gzip vllm-ascend-$TAG.tar
55
+
```
56
+
57
+
**Importing Docker images in environment without internet access:**
58
+
59
+
```{code-block} bash
60
+
:substitutions:
61
+
# Transfer the tar/tar.gz file to the offline environment and load it
62
+
TAG=|vllm_ascend_version|
63
+
docker load -i vllm-ascend-$TAG.tar.gz
64
+
65
+
# Verify the image is loaded
66
+
docker images | grep vllm-ascend
67
+
```
68
+
39
69
### 3. What models does vllm-ascend supports?
40
70
41
71
Find more details [<u>here</u>](https://vllm-ascend.readthedocs.io/en/latest/user_guide/support_matrix/supported_models.html).
0 commit comments