Integrate mamba SSM kernels from the hub

[romitjain]

Feature request

Currently, mamba kernels are imported via the main source package ex, for GraniteMoeHybrid

Can we migrate this to use the kernels-hub (kernels-community/mamba-ssm) variation instead?

Motivation

Removes the external dependency. Kernel hub is also integrated at several other places throughout the library.

Your contribution

I can submit a PR for migrating from the PyPi mamba_ssm package to the kernels package for mamba ops.

[vasqu]

Hey @romitjain, I think that would be very cool. We should keep the option to have the og package as well tho. We had a similar PR for causal-conv1d over here #40765

cc @MekkCyber to confirm if that's ok

[romitjain]

Thanks for the reference @vasqu
If you are good with the proposal, I will raise a PR.

PS: I can't seem to open the causal conv1d kernel package on the hub. Is that expected?

[vasqu]

Me neither xD might be set to private atm, let's wait for @MekkCyber to respond as he's more involved with kernels

[MekkCyber]

Yup sorry it's public now. Yes it's very cool to have mamba-ssm as well used in transformers from the hub. We already have kernels-community/mamba-ssm, You can definitely try to make it work and ping me when it's done 🤗 . If you have any issues with the kernel feel free to open an issue on the hub.

[romitjain]

Thanks @MekkCyber
Let me implement it and raise a PR

[romitjain]

The mamba_ssm kernel is not compatible with the latest transformers repo. I have raised a PR to fix it, can someone here please take a look or tag an appropriate member?

https://huggingface.co/kernels-community/mamba-ssm/discussions/3

(Maybe @MekkCyber)

Thank you

[romitjain]

I have also raised a draft PR (#41540), which is contingent on the hub PR being merged

[MekkCyber]

Thanks @romitjain ! will look into it and rebuild the kernel