-
Notifications
You must be signed in to change notification settings - Fork 2.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[Feature] Support kernel updation for some decoder heads. #1299
[Feature] Support kernel updation for some decoder heads. #1299
Conversation
Codecov Report
@@ Coverage Diff @@
## master #1299 +/- ##
==========================================
+ Coverage 90.22% 90.26% +0.03%
==========================================
Files 130 131 +1
Lines 7560 7611 +51
Branches 1258 1264 +6
==========================================
+ Hits 6821 6870 +49
Misses 531 531
- Partials 208 210 +2
Flags with carried forward coverage won't be shown. Click here to find out more.
Continue to review full report at Codecov.
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
minor revise
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
How about other decode_heads?
Keep others current contents while these four decoder heads would add docstrings in |
…#1299) * [Feature] Add kenerl updation for some decoder heads. * [Feature] Add kenerl updation for some decoder heads. * directly use forward_feature && modify other 3 decoder heads * remover kernel_update attr * delete unnecessary variables in forward function * delete kernel update function * delete kernel update function * delete unnecessary docstrings * modify comments in self._forward_feature() * modify docstrings in self._forward_feature() * fix docstring * modify uperhead
* add conversion script for vae * up * up * some fixes * add text model * use the correct config * add docs * move model in it's own file * move model in its own file * pass attenion mask to text encoder * pass attn mask to uncond inputs * quality * fix image2image * add imag2image in init * fix import * fix one more import * fix import, dummy objetcs * fix copied from * up * finish Co-authored-by: patil-suraj <surajp815@gmail.com>
Motivation
To support K-Net(https://arxiv.org/abs/2106.14855). In several decoder heads, add
kernel_update
to decide whether (1) feature map beforeself.cls_seg
and (2) learnable semantic kernels becoming output for kernel updation.Decoder heads needed to be modified
This pr would be merged as soon as possible to proceed the K-Net PR: #1289.