Skip to content

Commit

Permalink
fix docs (#2882)
Browse files Browse the repository at this point in the history
  • Loading branch information
Jintao-Huang committed Jan 10, 2025
1 parent d307635 commit 33ab2bd
Show file tree
Hide file tree
Showing 2 changed files with 2 additions and 2 deletions.
2 changes: 1 addition & 1 deletion docs/source/Instruction/推理和部署.md
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ SWIFT支持以命令行、Python代码和界面方式进行推理和部署:
- `single-line`命令 切换到单行模式
- `clear`命令 清除history
- `exit`命令 退出
- 如果query中带有多模态数据,添加<image>/<video>/<audio>等标签,例如输入`<image>What is in the image?`,即可在接下来输入图片地址
- 如果query中带有多模态数据,添加`<image>/<video>/<audio>`等标签,例如输入`<image>What is in the image?`,即可在接下来输入图片地址

## 推理加速后端

Expand Down
2 changes: 1 addition & 1 deletion docs/source_en/Instruction/Inference-and-deployment.md
Original file line number Diff line number Diff line change
Expand Up @@ -16,7 +16,7 @@ The command line inference can be referred to via the link provided in the secon
- The `single-line` command switches to single-line mode.
- The `clear` command clears the history.
- The `exit` command exits the application.
If the query involves multimodal data, add tags like <image>/<video>/<audio>. For example, input `<image>What is in the image?`, and you can then input the image address.
If the query involves multimodal data, add tags like `<image>/<video>/<audio>`. For example, input `<image>What is in the image?`, and you can then input the image address.

## Inference Acceleration Backend
You can perform inference and deployment using `swift infer/deploy`. Currently, SWIFT supports three inference frameworks: pt (native torch), vLLM, and LMDeploy. You can switch between them using `--infer_backend pt/vllm/lmdeploy`. Apart from pt, both vLLM and LMDeploy have their own model support ranges. Please refer to their official documentation to verify availability and prevent runtime errors.

0 comments on commit 33ab2bd

Please sign in to comment.