Query about ''offset''

[RayYoh]

Hi authors, thanks for your work. I am confused about the offset here. Since the residual is None, why need to use this offset instead of directly using the output hidden states.

[Aristo23333]

Hi authors, thanks for your work. I am confused about the offset here. Since the residual is None, why need to use this offset instead of directly using the output hidden states.

Hi ! Thanks for your interest in our work. The offset is designed referring to the offset design in PCT. I regard this as the a similar approximation of Laplace function mentioned by PCT, which is inherently permutation-invariant and more suitable for point cloud learning compare to the original Mamba block module. I also provide a simple prove as folllowed: