Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Operator] Further performance enhancements for conv2D #290

Merged
merged 55 commits into from
Jun 28, 2023

Conversation

Aalanli
Copy link
Collaborator

@Aalanli Aalanli commented Jun 23, 2023

  • changed matmul_fp16 to support last dimension a multiple of 2 or 4
  • added custom pre-transform kernel to replace auto scheduler generated version
  • moved padding to within the conv2d operator to remove redundant padding

@Aalanli
Copy link
Collaborator Author

Aalanli commented Jun 24, 2023

More changes:
there was a bug in the subgraph rewrite pass that did not include dilations and padding in the new op, therefore the output shapes after the pass are different.

@yaoyaoding
Copy link
Member

Hi @Aalanli, let me know (by ping me in the PR) if this PR is ready to be reviewed. Sometimes I am not sure whether a PR is ready to be reviewed even when the CI is passed. You can also add [WIP] prefix (work in progress) to the PR title explicitly if you are still working on a PR.

@Aalanli
Copy link
Collaborator Author

Aalanli commented Jun 26, 2023

Hi @yaoyaoding, thanks for the message. This PR is ready to be reviewed.

Copy link
Member

@yaoyaoding yaoyaoding left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @Aalanli, I left some comments.

python/hidet/graph/ops/conv2d/conv2d.py Outdated Show resolved Hide resolved
python/hidet/graph/ops/conv2d/conv2d.py Outdated Show resolved Hide resolved
python/hidet/graph/ops/matmul/matmul_f16.py Outdated Show resolved Hide resolved
tests/operators/test_conv2d.py Outdated Show resolved Hide resolved
tests/operators/test_conv2d_pretransform.py Outdated Show resolved Hide resolved
Copy link
Member

@yaoyaoding yaoyaoding left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me. Thanks @Aalanli !

@yaoyaoding yaoyaoding merged commit 7e87525 into hidet-org:main Jun 28, 2023
@Aalanli Aalanli deleted the conv2d-fp16v2 branch September 27, 2023 18:09
vadiklyutiy pushed a commit that referenced this pull request Jul 22, 2024
- setitem with tensor values
- boolean type promotion

---------

Co-authored-by: Zhumakhan <nazirzhumakhan@gmail,.com>
vadiklyutiy pushed a commit that referenced this pull request Jul 23, 2024
- setitem with tensor values
- boolean type promotion

---------

Co-authored-by: Zhumakhan <nazirzhumakhan@gmail,.com>
vadiklyutiy pushed a commit that referenced this pull request Dec 26, 2024
- setitem with tensor values
- boolean type promotion

---------

Co-authored-by: Zhumakhan <nazirzhumakhan@gmail,.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants