Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Confused about ablation table in the paper #1

Open
ulupo opened this issue Sep 6, 2024 · 1 comment
Open

Confused about ablation table in the paper #1

ulupo opened this issue Sep 6, 2024 · 1 comment

Comments

@ulupo
Copy link

ulupo commented Sep 6, 2024

Hi, cool work! I was reading your paper carefully and became extremely confused at the interpretation of your ablation results. I paste the table from Biorxiv below for convenience:
image

Normally, an ablation study means "remove one component, keep everything else the same". Under this interpretation, removing e.g. the focal loss does not have the largest negative impact, unless maybe you are only looking at the CAAR metric for all CDR predictions. But this is what is claimed in the text. Similar other commentary in section 3.5 does not line up with the numbers reported in the table. Clearly I am not interpreting the table correctly. Then, what is the intended interpretation? Thank you in advance!

@benyaminjami
Copy link
Owner

Thank you for noting this issue, and excuse me for the delayed response. You’re absolutely right—there was a discrepancy as we hadn't updated the explanation to match the latest results in the ablation study. I recently revised the manuscript to correct this and ensure that the commentary now accurately reflects the data. I appreciate your careful reading and bringing this to our attention!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants