Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Need inputs on V2-99 and EVA02 backbone. #95

Open
IAMShashankk opened this issue Feb 27, 2025 · 0 comments
Open

Need inputs on V2-99 and EVA02 backbone. #95

IAMShashankk opened this issue Feb 27, 2025 · 0 comments

Comments

@IAMShashankk
Copy link

Hi @afterthat97 ,

First of all, thanks for your continuous work on this topic. I have rarely seen an author close these many issues.

For one of my works, I am using your V2-99 and EVA02 implementation for backbone. But I am seeing a bit strange results.

  • My code with R18, R50 and ConvNext backbone works fine for validation (mAP: x, NDS: y) and test (mAP: x+2, NDS: y+1) set of nuscenes.
  • My code with V2-99 and EVA02 backbone (your implementation) works fine for validation (mAP: X, NDS: Y) but for the test (mAP: X-10, NDS: Y-5) does not work as expected.

I tried everything and verified my code, but I could not figure out the issue specific to using these two backbones. During validation I see that the model performs well, but on the test set it fails, and can't even achieve val accuracy.

Could you please give me some direction/points to look into, specific to these two backbones.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant