Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixed the regularization for BGU. #7684

Merged
merged 2 commits into from
Jul 24, 2023
Merged

Conversation

mcourteaux
Copy link
Contributor

See discussion in #7681.

This patch simplifies the regularization. The most important takeaway is in the comment of the changed code, and a thought I had: #7681 (comment) :

The only thing I'm not sure about is that I changed it to regularize towards the identity function, instead of "towards the average gain in the cell". The problem I have with "the average gain" is that you also need samples to compute the average gain, which is exactly the problem being solved.

@jiawen @abadams I don't know if you want to validate the result by running the experiment setup of your paper? I guess that will be a more formal test.

@mcourteaux
Copy link
Contributor Author

To compare the image I reported originally:

(before) https://user-images.githubusercontent.com/845012/253539155-09c73346-563f-4580-b781-089f4b0068ad.jpg

(after) https://user-images.githubusercontent.com/845012/253946895-792e6941-8cb4-475d-9a6c-95d48857d99c.jpg

Open both and toggle back and forth in two tabs. Result looks identical, except for the regularization artifacts.

@abadams
Copy link
Member

abadams commented Jul 17, 2023

Your argument about the original regularization makes sense to me. I'd appreciate @jiawen 's take on it though.

@steven-johnson
Copy link
Contributor

ASAN failures are unrelated

@steven-johnson
Copy link
Contributor

Ready to merge?

@steven-johnson steven-johnson merged commit ce16f91 into halide:main Jul 24, 2023
3 checks passed
@mcourteaux
Copy link
Contributor Author

🥳

ardier pushed a commit to ardier/Halide-mutation that referenced this pull request Mar 3, 2024
Co-authored-by: Steven Johnson <srj@google.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants