Skip to content

Commit

Permalink
fix deploy timeout (#2230)
Browse files Browse the repository at this point in the history
  • Loading branch information
Jintao-Huang committed Oct 14, 2024
1 parent 2237d20 commit 947cb30
Show file tree
Hide file tree
Showing 3 changed files with 3 additions and 3 deletions.
2 changes: 1 addition & 1 deletion docs/source/Instruction/命令行参数.md
Original file line number Diff line number Diff line change
Expand Up @@ -411,7 +411,7 @@ eval参数继承了infer参数,除此之外增加了以下参数:(注意:
- `--eval_output_dir`: 评测结果输出路径, 默认是当前文件夹下的`eval_outputs`路径.
- `--eval_batch_size`: 评测的输入batch_size, 默认是8
- `--eval_nproc`: 并发数, 更大的并发数可以更快评测, 但显存占用也更高, 默认值16. 本参数仅对多模态评测生效.
- `--deploy_timeout`: 评测之前会启动模型部署, 该参数设置部署的等待超时时长, 默认值为60, 代表一分钟.
- `--deploy_timeout`: 评测之前会启动模型部署, 该参数设置部署的等待超时时长, 默认值为`1800`, 代表30分钟.


## app-ui 参数
Expand Down
2 changes: 1 addition & 1 deletion docs/source_en/Instruction/Command-line-parameters.md
Original file line number Diff line number Diff line change
Expand Up @@ -412,7 +412,7 @@ The eval parameters inherit from the infer parameters, and additionally include
- `--eval_output_dir`: Output path for evaluation results, default is `eval_outputs` in the current folder.
- `--eval_batch_size`: Input batch size for evaluation, default is 8.
- `--eval_nproc`: Concurrent number, a bigger value means a faster evaluation and more cost of GPU memory, default 16. This only takes effects when running multi-modal evaluations.
- `--deploy_timeout`: The timeout duration for waiting for model deployment before evaluation, default is 60, which means one minute.
- `--deploy_timeout`: The timeout duration for waiting for model deployment before evaluation, default is `1800`, which means 30 minutes.

## app-ui Parameters

Expand Down
2 changes: 1 addition & 1 deletion swift/llm/utils/argument.py
Original file line number Diff line number Diff line change
Expand Up @@ -1602,7 +1602,7 @@ class EvalArguments(InferArguments):
eval_output_dir: str = 'eval_outputs'
eval_backend: Literal['Native', 'OpenCompass'] = 'OpenCompass'
eval_batch_size: int = 8
deploy_timeout: int = 60
deploy_timeout: int = 1800

do_sample: bool = False # Note: for evaluation default is False
temperature: float = 0.
Expand Down

0 comments on commit 947cb30

Please sign in to comment.