Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

咨询一下，如何在paddleserving里面设置并发执行的模块？ #1121

Closed
allenxln opened this issue Apr 8, 2021 · 5 comments
Closed

咨询一下，如何在paddleserving里面设置并发执行的模块？ #1121

allenxln opened this issue Apr 8, 2021 · 5 comments
Assignees
@TeslaZhao
Labels
question Further information is requested

Comments

@allenxln
Copy link

allenxln commented Apr 8, 2021

如题，没找到相关的并发处理的位置，感谢解答。
@github-actions
Copy link

github-actions bot commented Apr 8, 2021

Message that will be displayed on users' first issue

@meishitouzhele
Copy link

如何才能最大限度利用算力卡 达到80%以上利用率？

@TeslaZhao
Copy link
Collaborator

TeslaZhao commented Apr 9, 2021 •
edited
Loading

可以使用Pipeline Serving的模式，通过设置OP并发进程数量，实现多进程推理。其次，支持单机多卡推理，最大化利用算力。
https://github.com/PaddlePaddle/Serving/blob/develop/doc/PIPELINE_SERVING_CN.md

@TeslaZhao TeslaZhao self-assigned this Apr 9, 2021
@TeslaZhao TeslaZhao added the question Further information is requested label Apr 10, 2021
@meishitouzhele
Copy link

请问这个Pipeline Serving的模式 都支持什么环境 什么版本？

@TeslaZhao
Copy link
Collaborator

Linux或Docker环境
安装Serving v0.5.0版本

@paddle-bot paddle-bot bot closed this as completed Mar 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@TeslaZhao TeslaZhao

Labels
question Further information is requested
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@TeslaZhao @meishitouzhele @allenxln