What's the use case for the "Discard weights with matching name" in the model merge tab? #8157
Unanswered
WildBanjos
asked this question in
Q&A
Replies: 1 comment 2 replies
-
Very late response, but for anyone finding this later - it's to discard NonEMA weights AKA prune the model. (Or as the label mistakenly suggests, you can discard the EMA weights and prune the wrong half of the model I guess). (NonEMA = Training weights, EMA = Inference weights. In practice only the inference weights matter as training-resuming never happens. Also in practice the difference barely matters as EMA doesn't change much in diffusion models). |
Beta Was this translation helpful? Give feedback.
2 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
So, apparently in commit 112416d an option was added in the checkpoint merger tab to remove weights with matching name. Just curious what the intended use case is or if anyone else has experimented with this yet.
Beta Was this translation helpful? Give feedback.
All reactions