Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Grounding DINO For zero-shot object detection go ahead and build from the following example: #25

Open
lfreee opened this issue Aug 23, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@lfreee
Copy link

lfreee commented Aug 23, 2024

*************** EP Error ***************
EP Error /onnxruntime_src/onnxruntime/python/onnxruntime_pybind_state.cc:754 std::unique_ptronnxruntime::IExecutionProvider onnxruntime::python::CreateExecutionProviderInstance(const onnxruntime::SessionOptions&, const string&, const ProviderOptionsMap&) Invalid TensorRT EP option: trt_engine_hw_compatible
when using [('TensorrtExecutionProvider', {'trt_engine_cache_enable': True, 'trt_max_workspace_size': 4294967296, 'trt_engine_cache_path': '/root/sevnce/liufurui/vision-at-a-clip-main/gdino/data', 'trt_engine_hw_compatible': True, 'trt_sparsity_enable': True, 'trt_build_heuristics_enable': True, 'trt_builder_optimization_level': 0, 'trt_fp16_enable': False}), 'CUDAExecutionProvider', 'CPUExecutionProvider']
Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.

@rhysdg rhysdg self-assigned this Sep 3, 2024
@rhysdg rhysdg added the bug Something isn't working label Sep 3, 2024
@rhysdg
Copy link
Owner

rhysdg commented Sep 3, 2024

Hey @lfreee! Apologies for missing this issue here, I've had a pretty busy schedule recently. This was identified recently as a deprecated execution provider argument and I'll send through and update shortly.

Note that I have a big update coming through shortly that outdoes the full onnxruntime approach by pulling out the BERT stage and compillng with a TensorRT backend. End to end I'm getting about 200-300 ms on my RTX 3080.

The remainder of the network remian a bit of a problem with full compilation - The swin Transformer backbone has some unsupported operations etc so I'm still looking into that

@rhysdg rhysdg pinned this issue Sep 3, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants