Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The loss doesn't decrease #12

Open
hugo-xie opened this issue Jul 3, 2024 · 3 comments
Open

The loss doesn't decrease #12

hugo-xie opened this issue Jul 3, 2024 · 3 comments

Comments

@hugo-xie
Copy link

hugo-xie commented Jul 3, 2024

Hello, I'm trying to train InteractDiffusion using the HOI dataset according to the readme, but I've noticed that the loss isn't decreasing. Instead, it's fluctuating. Is this normal?
截屏2024-07-03 16 43 46

@jiuntian
Copy link
Owner

jiuntian commented Jul 3, 2024

Yes it's normal

@hugo-xie
Copy link
Author

hugo-xie commented Jul 4, 2024

Yes it's normal

So does the loss remain in a fluctuating state from the beginning to the end of training? How do we then choose the final model checkpoint

@jiuntian
Copy link
Owner

jiuntian commented Jul 4, 2024

we did evaluation per 100k

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants