-
Notifications
You must be signed in to change notification settings - Fork 454
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merging of ONNX decoder >2GB fails #894
Comments
Hi. I'm using the cli command:
and getting the same error:
Environment:
Optimum version tested:
|
@vilsonrodrigues This is fixed on main, thanks for notifying! |
Thanks @fxmarty!! |
Dear @fxmarty I get a similar error using these versions: optimum version: 1.8.7 optimum-cli export onnx --model stabilityai/stablelm-tuned-alpha-7b stablelm-tuned-alpha-7b_onnx/ ERROR: Detailed error: Unable to merge decoders. Detailed error: Data of TensorProto ( tensor name: gpt_neox.embed_in.weight_merged_0) should be stored in decoder_model_merged.onnx_data, but it doesn't exist or is not accessible. |
Thanks, tracked in #1044 |
System Info
Who can help?
No response
Information
Tasks
examples
folder (such as GLUE/SQuAD, ...)Reproduction
optimum-cli export onnx --model gpt2-large gpt2_onnx
Traceback:
Expected behavior
no error
The text was updated successfully, but these errors were encountered: