Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Relay][BYOCG] Propagate constant to subgraphs #5094

Merged
merged 2 commits into from
Mar 20, 2020

Conversation

zhiics
Copy link
Member

@zhiics zhiics commented Mar 18, 2020

Currently, all constants are not propagated to the functions that will be handled by external codegen. This may cause some performance issue if a function is frequently used as you will need to pass the constants multiple times to accelerates. This PR binds the constants to the new functions and propagate them. As expected, this will need the 3rd-party codegen to handle the constants by themselves.

@comaniac @mbaret @soiferj @trevor-m @tqchen

@trevor-m
Copy link
Contributor

Thank you!
I have tested this for my external codegen and it fixes a few problems I was having.

Copy link
Contributor

@comaniac comaniac left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@mbaret
Copy link
Contributor

mbaret commented Mar 19, 2020

I think @lhutton1 has had an issue that might be related, maybe he can take a look.

@lhutton1
Copy link
Contributor

Just tested it out with my codegen and works well, thanks for this!

@zhiics zhiics merged commit 5088a03 into apache:master Mar 20, 2020
@zhiics
Copy link
Member Author

zhiics commented Mar 20, 2020

Thanks everybody. This is now merged.

@zhiics zhiics deleted the bind_params branch March 20, 2020 21:51
trevor-m pushed a commit to trevor-m/tvm that referenced this pull request Apr 16, 2020
* bind constant to subgraphs

* con -> constant
zhiics added a commit to neo-ai/tvm that referenced this pull request Apr 17, 2020
* bind constant to subgraphs

* con -> constant
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants