New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix length assertion in `Tensor::slice` #3

Open

fgh1999 wants to merge 1 commit into LearningInfiniTensor:main from fgh1999:fix-slice-assert

fgh1999 commented Aug 21, 2024

self.offset应该不计入self.length？
传入self_attention的q的shape如在forward下的layer loop中不再reshape的话，应为(seq, n_kv_h * n_groups, dqkv)


          Fix length assertion in Tensor::slice;

ed93443

Fix the shape comment of `q` in `self_attention`.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet