Skip to content

Commit

Permalink
[llm] update docs
Browse files Browse the repository at this point in the history
  • Loading branch information
kevincheng2 committed Nov 21, 2024
1 parent 1b3e69c commit 084fbb8
Showing 1 changed file with 5 additions and 3 deletions.
8 changes: 5 additions & 3 deletions llm/docs/FastDeploy_usage_tutorial.md
Original file line number Diff line number Diff line change
Expand Up @@ -47,7 +47,7 @@ FastDeploy 为 PaddleNLP 静态图模型提供了高效的部署方案,模型
```
cd /home/workspace/models_dir
# 导出的模型目录结构格式如下所示,理论上无缝支持 PaddleNLP 导出静态图模型,无需修改模型目录结构
# 导出的模型目录结构格式如下所示,理论上无缝支持 PaddleNLP 导出的静态图模型,无需修改模型目录结构
# /opt/output/Serving/models
# ├── config.json # 模型配置文件
# ├── xxxx.model # 词表模型文件
Expand Down Expand Up @@ -138,10 +138,12 @@ bash start_server.sh

```
# port为上面启动服务时候指定的HTTP_PORT
> 测试前请确保服务IP和端口正确
live接口: (服务是否能正常接收请求)
http://{ip}:{HTTP_PORT}/v2/health/live
http://127.0.0.1:8110/v2/health/live
health接口:(模型是否准备好推理)
http://{ip}:{HTTP_PORT}/v2/health/ready
http://127.0.0.1:8110/v2/health/ready
```

## 服务测试
Expand Down

0 comments on commit 084fbb8

Please sign in to comment.