[CANN] Add Ascend NPU support #2552
Open
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
Hi @nttstar, thank you for this great job. Because the onnxruntime is officially support Ascend with CANN EP, it does not modify too much code to adapt this project. May i know if this could be merged or what else do i need to do? More Information Ascend is a full-stack AI computing infrastructure for industry applications and services based on Huawei Ascend processors and software. For more information about Ascend, see Ascend Community. |
wangshuai09
force-pushed
the
npu_support
branch
from
6c22317 to
6f20e92
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation
Hi, thanks for your great work! I've run insightface on my Ascend NPU Device and then want to make this contribution for other users using the same hardware. Would love to get feedback :)
ONNX Runtime has nativaly supported Ascend NPU since v1.12.1, more information in ONNX Runtime-CANN-ExecutionProvider
Change
This PR supports Ascend NPU as a new backend for insightface.
Test
Person Detection Test with 2k images
cpu: 19.6 FPS
npu: 69.7 FPS
Web-demo Test
sim: 0.6081, message: They ARE the same personsim: 0.0444, message: They are NOT the same person