Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Problem reproducing CRST-MRKLD result #31

Open
Nadavc220 opened this issue Oct 20, 2020 · 3 comments
Open

Problem reproducing CRST-MRKLD result #31

Nadavc220 opened this issue Oct 20, 2020 · 3 comments

Comments

@Nadavc220
Copy link

Hi,
I ran the mrkld.sh script with the right data paths. I did not change anything else.
The training process seems to have something wrong, The mIoU is going down drastically in every round all the way down to around 4% success.

Is there anything else needed to ne done on order to reproduce the 47% result?

@yzou2
Copy link
Owner

yzou2 commented Oct 22, 2020

This is a similar issue as #22 .

The code is tested in Pytorch 0.4.0 and Python 2.7. We found running the code with other Pytorch versions will give different results. I suggest to run the code with the exact Pytorch version 0.4.0. Different performances on even 0.4.1 were reported by other users of this code.

@Nadavc220
Copy link
Author

forgot to thank you for your comment.
Thanks!

@quantacode
Copy link

quantacode commented May 7, 2021

Hi,

I found for crst_seg.py, commenting out the random seed gave me correct test results. Otherwise the accuracies are way too low. Nevertheless, running the training as it is still leads to the same problem. Can you verify if the random seed is indeed the issue?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants