Skip to content

Commit cbba147

Browse files
committed
[Doc] Add Docker export/import guide for air-gapped environments
Signed-off-by: QwertyJack <7554089+QwertyJack@users.noreply.github.com>
1 parent 992271b commit cbba147

File tree

1 file changed

+30
-0
lines changed

1 file changed

+30
-0
lines changed

docs/source/faqs.md

Lines changed: 30 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,6 +36,36 @@ TAG=v0.7.3rc2
3636
docker pull m.daocloud.io/quay.io/ascend/vllm-ascend:$TAG
3737
```
3838

39+
#### Load Docker Images for offline environment
40+
If you want to use container image for offline environments (no internet connection), you need to download container image in a environment with internet access:
41+
42+
**Exporting Docker images:**
43+
44+
```{code-block} bash
45+
:substitutions:
46+
# Pull the image on a machine with internet access
47+
TAG=|vllm_ascend_version|
48+
docker pull quay.io/ascend/vllm-ascend:$TAG
49+
50+
# Export the image to a tar file
51+
docker save quay.io/ascend/vllm-ascend:$TAG -o vllm-ascend-$TAG.tar
52+
53+
# Optional: Compress to reduce file size
54+
gzip vllm-ascend-$TAG.tar
55+
```
56+
57+
**Importing Docker images in environment without internet access:**
58+
59+
```{code-block} bash
60+
:substitutions:
61+
# Transfer the tar/tar.gz file to the offline environment and load it
62+
TAG=|vllm_ascend_version|
63+
docker load -i vllm-ascend-$TAG.tar.gz
64+
65+
# Verify the image is loaded
66+
docker images | grep vllm-ascend
67+
```
68+
3969
### 3. What models does vllm-ascend supports?
4070

4171
Find more details [<u>here</u>](https://vllm-ascend.readthedocs.io/en/latest/user_guide/support_matrix/supported_models.html).

0 commit comments

Comments
 (0)