Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[TFLite runtime] Allow to set number of threads to TFLite interpreter #6901

Merged
merged 2 commits into from
Nov 12, 2020

Conversation

tmoreau89
Copy link
Contributor

Co-authored-by: FrozenGene zhaowu@apache.org

This PR lets us set the number of threads used by the TFLite interpreter in order to evaluate TFLite performance over RPC at different thread counts.

Co-authored-by: FrozenGene <zhaowu@apache.org>
Copy link
Member

@FrozenGene FrozenGene left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally, LGTM. Just one minor comment.

num_threads : int
The number of threads
"""
self._set_num_threads(num_threads)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

how about adding one new line at the end of file to meet the requirement of PEP8?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Makes sense

@tqchen tqchen merged commit f952fa7 into apache:main Nov 12, 2020
trevor-m pushed a commit to trevor-m/tvm that referenced this pull request Dec 2, 2020
…apache#6901)

* Support for setting thread count in TFLite runtime,

Co-authored-by: FrozenGene <zhaowu@apache.org>

* fix lint

Co-authored-by: FrozenGene <zhaowu@apache.org>
trevor-m pushed a commit to trevor-m/tvm that referenced this pull request Dec 4, 2020
…apache#6901)

* Support for setting thread count in TFLite runtime,

Co-authored-by: FrozenGene <zhaowu@apache.org>

* fix lint

Co-authored-by: FrozenGene <zhaowu@apache.org>
trevor-m pushed a commit to neo-ai/tvm that referenced this pull request Dec 4, 2020
…apache#6901)

* Support for setting thread count in TFLite runtime,

Co-authored-by: FrozenGene <zhaowu@apache.org>

* fix lint

Co-authored-by: FrozenGene <zhaowu@apache.org>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants