Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reproducing the results in different platform #8

Open
wwzjer opened this issue Apr 25, 2022 · 1 comment
Open

Reproducing the results in different platform #8

wwzjer opened this issue Apr 25, 2022 · 1 comment

Comments

@wwzjer
Copy link

wwzjer commented Apr 25, 2022

Dear authors,

thank you for sharing the codes of your nice work! However, when we tried the code, we found that the results are not very consistent on different platforms. Specifically, we made three trials (without any modification to the source code):
[1] On a single GTX 1080Ti, the final accuracy is 88.85;
[2] On a single RTX 3090, the final accuracy is 88.33;
[3] On a single A40, the final accuracy is 88.62.

We are curious why this phenomenon happens. Also, we wonder if the authors could provide some suggestions on reproducing the results. Thank you!

@zyh-uaiaaaa
Copy link
Owner

zyh-uaiaaaa commented Apr 28, 2022

Hi. We think that completely reproducing the results are not guaranteed across PyTorch releases, different platforms or CPU/GPU executions, even when using identical seeds.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants