Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Upgrade ONNX runtime #63

Open
dandiep opened this issue Oct 31, 2022 · 1 comment
Open

Upgrade ONNX runtime #63

dandiep opened this issue Oct 31, 2022 · 1 comment

Comments

@dandiep
Copy link

dandiep commented Oct 31, 2022

Is it possible to upgrade the ONNX runtime dependency to the latest? The old version has some bugs (e.g. doesn't work on aws lambda arm64)

@ka00ri
Copy link

ka00ri commented Dec 14, 2022

same issue encountered while installing on a m1 device.
To install, I upgraded the version in setup.py and to run it, I had to remove the parameter activation_type in quantize_dynamic().

        quantize_dynamic(
            model_input=model_name,
            model_output=output_model_name,
            per_channel=True,
            reduce_range=True, # should be the same as per_channel
            # activation_type=QuantType.QUInt8,
            weight_type=QuantType.QInt8,  # per docs, signed is faster on most CPUs
            optimize_model=False,
        )  # op_types_to_quantize=['MatMul', 'Relu', 'Add', 'Mul' ],

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants