Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

About M #4

Open
zzry420 opened this issue May 30, 2023 · 1 comment
Open

About M #4

zzry420 opened this issue May 30, 2023 · 1 comment

Comments

@zzry420
Copy link

zzry420 commented May 30, 2023

Thank you for your excellent work! We noticed in your paper that M refers to the distance threshold of local connectivity in self-attention, can you explain in detail how to understand the distance threshold?

Note that N and M denote
the number of vertices and the distance threshold for defining the local connection in self-attention, respectively.

@kmk3942
Copy link
Member

kmk3942 commented Jun 27, 2023

Sorry for the late reply.

Based on the graph of the vertex connection on the mesh surface, we define four different attention masks according to the number of connected vertices to take into account. And this number is the distance threshold, i.e., 1, 3, 5, 7.
For easier understanding, please check our video(from 3:32) which shows some visualizations about how to define the attention mask.
https://youtu.be/VZA5Y0xgtBg?t=212

Hope my answer is helpful.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants