-
Notifications
You must be signed in to change notification settings - Fork 3.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[TFLite runtime] Allow to set number of threads to TFLite interpreter #6901
Conversation
Co-authored-by: FrozenGene <zhaowu@apache.org>
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Generally, LGTM. Just one minor comment.
python/tvm/contrib/tflite_runtime.py
Outdated
num_threads : int | ||
The number of threads | ||
""" | ||
self._set_num_threads(num_threads) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
how about adding one new line at the end of file to meet the requirement of PEP8?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Makes sense
…apache#6901) * Support for setting thread count in TFLite runtime, Co-authored-by: FrozenGene <zhaowu@apache.org> * fix lint Co-authored-by: FrozenGene <zhaowu@apache.org>
…apache#6901) * Support for setting thread count in TFLite runtime, Co-authored-by: FrozenGene <zhaowu@apache.org> * fix lint Co-authored-by: FrozenGene <zhaowu@apache.org>
…apache#6901) * Support for setting thread count in TFLite runtime, Co-authored-by: FrozenGene <zhaowu@apache.org> * fix lint Co-authored-by: FrozenGene <zhaowu@apache.org>
Co-authored-by: FrozenGene zhaowu@apache.org
This PR lets us set the number of threads used by the TFLite interpreter in order to evaluate TFLite performance over RPC at different thread counts.