Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Paddle-TRT] Update to new serialized API when using trt8 #36769

Merged
merged 1 commit into from
Oct 27, 2021

Conversation

zlsh80826
Copy link
Collaborator

PR types

Bug fixes

PR changes

Others

Describe

TensorRT 8 has a new API to create engine and to serialize host memory.
There is a bug that use the new create engine API and the old serialize API.

This PR fix the problem by

  1. TRT7: use old engine API (buildEngineWithConfig) + old serialized API (ICudaEngine::serialize())
  2. TRT8: use new engine API (buildSerializedNetwork) for both engine create and serialization

@paddle-bot-old
Copy link

Thanks for your contribution!
Please wait for the result of CI firstly. See Paddle CI Manual for details.

@b3602sss b3602sss merged commit d6b1beb into PaddlePaddle:develop Oct 27, 2021
b3602sss pushed a commit to b3602sss/Paddle that referenced this pull request Oct 27, 2021
Superjomn pushed a commit that referenced this pull request Oct 27, 2021
Co-authored-by: zlsh80826 <zlsh80826@gmail.com>
ghost pushed a commit to piotrekobi/Paddle that referenced this pull request Nov 3, 2021
@zlsh80826 zlsh80826 deleted the fix-trt8-serialize branch January 7, 2022 01:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants