Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

你好,请问SelectiveScanMamba, SelectiveScanCore, SelectiveScanOflex和mamba提出的selective_scan_fn有什么区别吗? #305

Open
melooooody opened this issue Sep 21, 2024 · 1 comment

Comments

@melooooody
Copy link

貌似SelectiveScanOflex效率要高些?

@MzeroMiko
Copy link
Owner

SelectiveScanMamba is a wrapper of selective_scan_fn.
SelectiveScanCore delete some codes in mamba so that the code runs faster.
SelectiveScanOflex support input with dtype float16 and output with float32, so that you don't have to convert the input into float32 in advance, which also raises the speed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants