Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to solve this error: "ForeignNode does not support data-dependent shape for now" #3903

Open
demuxin opened this issue May 27, 2024 · 3 comments
Assignees
Labels
triaged Issue has been triaged by maintainers

Comments

@demuxin
Copy link

demuxin commented May 27, 2024

Description

I am convert this model from onnx to tensorrt engine.

when I had a test using polygraphy run --trt model.onnx command, and it appeared a error:

[E] 2: [myelinBuilderUtils.cpp::getMyelinSupportType::1270] Error Code 2: Internal Error (ForeignNode does not support data-dependent shape for now.)
[!] Invalid Engine. Please ensure the engine was built correctly
[E] FAILED | Runtime: 22.843s | Command: /home/osmagic/anaconda3/envs/pytorch/bin/polygraphy run --trt 

I run the command polygraphy run --onnxrt model.onnx, and there is on error.

I searched for this error, found a relative issue 3372

It said: We still don't support this, but it's in our plan and there are some effort on it.

Is this feature supported now?

If not, how can I solve this error by modifying the source code?

How can I find out which operator is causing the error?

Environment

TensorRT Version: 10.0

NVIDIA GPU: GeForce RTX 3090

NVIDIA Driver Version: 535.161.08

CUDA Version: 12.2

Operating System: ubuntu22.04

Python Version (if applicable): 3.9.7

Tensorflow Version (if applicable):

PyTorch Version (if applicable): 2.2.1

Relevant Files

Model link:
onnx model link

@zerollzeng
Copy link
Collaborator

DDS(data-dependent shape) is still under active development and there are still some restriction. please check our developer guide and api doc for more information.

@zerollzeng zerollzeng self-assigned this Jun 1, 2024
@zerollzeng zerollzeng added the triaged Issue has been triaged by maintainers label Jun 1, 2024
@demuxin
Copy link
Author

demuxin commented Jun 3, 2024

Thank you for response. Can you provide me with some relevant document links?

@demuxin
Copy link
Author

demuxin commented Jun 13, 2024

Hi, @zerollzeng,

How can I find out which operator is causing the error?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

2 participants