Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

EinFFT as a channel mixer for other architectures #14

Open
Xynonners opened this issue May 8, 2024 · 0 comments
Open

EinFFT as a channel mixer for other architectures #14

Xynonners opened this issue May 8, 2024 · 0 comments

Comments

@Xynonners
Copy link

Hi there,

I read the research paper, however one thing I was wondering is what would happen if one were to mate EinFFT to a different architecture, for example standard transformers instead of Mamba in place of the MLP/FF? I would understand if the EinFFT were built for Mamba specifically but would be interested to find the answer to this question.

Thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant