Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: Look through on_device annotations when looking for shape constants #9345

Merged
merged 1 commit into from
Oct 22, 2021

Conversation

mbs-octoml
Copy link
Contributor

#8788 introduced a perf regression
since a shape.as<ConstantNode> in alloc_tensor was always failing
due to the extra on_device annotation on the constant. Fixed that,
and introduced some helpers to make this situation easier to deal with.

(This is CORE-102 in OctoML JIRA).

@mbs-octoml
Copy link
Contributor Author

@mbrookhart for review if you have a chance

apache#8788 introduced a perf regression
since a `shape.as<ConstantNode>` in `alloc_tensor` was always failing
due to the extra `on_device` annotation on the constant. Fixed that,
and introduced some helpers to make this situation easier to deal with.

(This is CORE-102 in OctoML JIRA).

(Second try -- test_crp.py failure seems unrelated)
@masahi masahi merged commit 5ca646b into apache:main Oct 22, 2021
@mbs-octoml mbs-octoml deleted the mbs-CORE-102 branch October 22, 2021 16:44
AndrewZhaoLuo added a commit to AndrewZhaoLuo/tvm that referenced this pull request Oct 25, 2021
…aoLuo/tvm into aluo/qnn/conv2d-transpose-fixes

* 'aluo/qnn/conv2d-transpose-fixes' of github.com:AndrewZhaoLuo/tvm: (27 commits)
  fix keras
  jostle
  more frontend tests fixes
  remove f2qi for later pr
  remove formatting only change
  undo just formatting changes
  lint
  add todo
  fix fake quantization pass
  fix qnn conv2d transpose tests
  fix vitis tests
  change layouts for conv2d_transpose too
  fix bug with layout transform
  add test
  lint
  make pytorch tests pass
  fix a lot of initial tests
  Disable Hexagon TestConv2dPackedFilter test (apache#9344)
  BUG: Look through on_device annotations when looking for shape constants (apache#9345)
  [Community] @ganler -> Reviewer (apache#9346)
  ...
ylc pushed a commit to ylc/tvm that referenced this pull request Jan 7, 2022
…nts (apache#9345)

apache#8788 introduced a perf regression
since a `shape.as<ConstantNode>` in `alloc_tensor` was always failing
due to the extra `on_device` annotation on the constant. Fixed that,
and introduced some helpers to make this situation easier to deal with.

(This is CORE-102 in OctoML JIRA).

(Second try -- test_crp.py failure seems unrelated)
ylc pushed a commit to ylc/tvm that referenced this pull request Jan 13, 2022
…nts (apache#9345)

apache#8788 introduced a perf regression
since a `shape.as<ConstantNode>` in `alloc_tensor` was always failing
due to the extra `on_device` annotation on the constant. Fixed that,
and introduced some helpers to make this situation easier to deal with.

(This is CORE-102 in OctoML JIRA).

(Second try -- test_crp.py failure seems unrelated)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants