Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for RemBERT in the ONNX export #2092

Open
mlynatom opened this issue Nov 8, 2024 · 1 comment
Open

Add support for RemBERT in the ONNX export #2092

mlynatom opened this issue Nov 8, 2024 · 1 comment
Labels
onnx Related to the ONNX export

Comments

@mlynatom
Copy link

mlynatom commented Nov 8, 2024

Feature request

Add RemBERT to supported architectures for ONNX export.

Motivation

The support for RemBert was previously available in Transformers see here. However, now it seems that RemBERT is no longer supported.

Your contribution

I can help by testing implementation or providing the code if provided by some tutorial. I was not able to find documentation on how to do that.

@IlyasMoutawwakil
Copy link
Member

Hi, I would love to review a PR, adding a model is usually something like https://github.com/huggingface/optimum/pull/1161/files
where we add a model config (in this case it will just inherit from bert text encoder config) and the appropriate hub models for testing.

@IlyasMoutawwakil IlyasMoutawwakil added the onnx Related to the ONNX export label Nov 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
onnx Related to the ONNX export
Projects
None yet
Development

No branches or pull requests

2 participants