Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to Reproduce AP score on kitti test dataset ? #48

Open
techshoww opened this issue May 10, 2022 · 2 comments
Open

How to Reproduce AP score on kitti test dataset ? #48

techshoww opened this issue May 10, 2022 · 2 comments

Comments

@techshoww
Copy link

techshoww commented May 10, 2022

I have run the official MonoFlex pretrained model and code on kitti test dataset , got below score:
image

There is a big gap between above score and MonoFlex's official score.
So, how can i reproduce the score on kitti test leadboard ? How to generate predictions on kitti test dataset?

@techshoww techshoww changed the title Reproducing AP score on kitti test dataset How to Reproduce AP score on kitti test dataset ? May 11, 2022
@Magicboomliu
Copy link

I believe the pre-trained model has been trained on KITTI-train split only(about 3K images), the benchmark result was conducted with the model trained on KITTI-trainval(7.5K images).

@QiuDeZhang
Copy link

我已经在kitti测试数据集上运行了官方的MonoFlex预训练模型和代码,得到了以下分数: image

以上分数与MonoFlex的官方分数之间存在很大差距。那么,我怎样才能在kitti测试铅板上重现分数呢?如何在kitti测试数据集上生成预测?
请问你在kitti测试集上有达到论文里面的效果吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants