Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Questions about the evaluation results of Kitti (2015) #74

Open
cp319 opened this issue Aug 29, 2022 · 4 comments
Open

Questions about the evaluation results of Kitti (2015) #74

cp319 opened this issue Aug 29, 2022 · 4 comments

Comments

@cp319
Copy link

cp319 commented Aug 29, 2022

The following figure shows the expected results obtained by using the 'kitti_finetuned_model.pth.tar'
image
However, I can not get the evaluation results in the following table.
image
Note that I haven't made any fine adjustments to the model.

@cp319
Copy link
Author

cp319 commented Aug 29, 2022

This is a very good job. However, the above problems may be caused by some unknown problems. Thank you.

@mli0603
Copy link
Owner

mli0603 commented Sep 4, 2022

Hi @cp319

Thank you for your interest in the project. I am not able to reproduce your error. Maybe you have something off during your evaluation? Please see the result I just ran today. I have also attached the log file for your reference.

image
epoch_0.log

@cp319
Copy link
Author

cp319 commented Sep 5, 2022

Hi @cp319

Thank you for your interest in the project. I am not able to reproduce your error. Maybe you have something off during your evaluation? Please see the result I just ran today. I have also attached the log file for your reference.

image epoch_0.log

Thank you very much for your reply, but I doubt whether you used the model 'kitti_finetuned_model.pth.tar' you released for evaluation.

@mli0603
Copy link
Owner

mli0603 commented Sep 5, 2022

@cp319

Yes. I am using the same file.

Here is the set of arguments I used for your reference.

--epochs
1
--batch_size
1
--dataset
kitti2015
--dataset_directory
/data/Data/KITTI/2015
--checkpoint
inference
--num_workers
2
--eval
--validation
validation_all
--apex
--resume
YOUR_PATH_TO_PRETRAINED_MODEL

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants