Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Broadcast statistics computed on dataset when using DDP #107

Open
YutackPark opened this issue Oct 22, 2024 · 0 comments
Open

Broadcast statistics computed on dataset when using DDP #107

YutackPark opened this issue Oct 22, 2024 · 0 comments

Comments

@YutackPark
Copy link
Member

Currently, 7net redundantly computes the statistics of dataset and retrieve shift scale for each process. It may run incorrectly if some shift scale is obtained from a regression model, if the algorithm is not deterministic.

While there is no such method exists in 7net (at least for now) and we use fixed random seed for numpy and torch at the beginning, it is still good practice to ensure it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant