Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Support receptive field search of CNN models. (TPAMI paper rf-next) #8191

Merged
merged 35 commits into from
Dec 22, 2022
Merged

Support receptive field search of CNN models. (TPAMI paper rf-next) #8191

merged 35 commits into from
Dec 22, 2022

Conversation

gasvn
Copy link
Contributor

@gasvn gasvn commented Jun 15, 2022 •
edited
Loading

Motivation

Merging a general receptive field search method to mmcv and mmdet. (paper: RF-Next: Efficient Receptive Field Search for Convolutional Neural Networks TPAMI 2022 pdf)
RF-Next can improve the performance of many CNN networks on many tasks.
more results on https://github.com/ShangHua-Gao/RF-mmdetection/tree/rfsearch/configs/rfnext

Modification

Add rfsearch

BC-breaking (Optional)

Does the modification introduce changes that break the backward-compatibility of the downstream repos?
If so, please describe how it breaks the compatibility and how the downstream projects should modify their code to keep compatibility with this PR.

Use cases (Optional)

If this PR introduces a new feature, it is better to list some use cases here, and update the documentation.
This PR relay on open-mmlab/mmcv#2056

Checklist

  1. Pre-commit or other linting tools are used to fix the potential lint issues.
  2. The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
  3. If the modification has potential influence on downstream projects, this PR should be tested with downstream projects, like MMDet or MMCls.
  4. The documentation has been modified accordingly, like docstring or example tutorials.

@CLAassistant
Copy link

CLAassistant commented Jun 15, 2022 •
edited
Loading

CLA assistant check
All committers have signed the CLA.

@gasvn gasvn mentioned this pull request Jun 15, 2022
Merged
7 tasks
@shinya7y
Copy link
Contributor

Congratulations on the PAMI acceptance!
Could the codes for ConvNeXt be cleaned based on #7281 ?

@ZwwWayne ZwwWayne requested a review from jbwang1997 June 15, 2022 14:48
@jbwang1997
Copy link
Collaborator

The codes in mmcv_custom need to be put into mmcv.

@gasvn
Copy link
Contributor Author

gasvn commented Jun 16, 2022

All codes related to convnext are removed.

@BIGWangYuDong
Copy link
Collaborator

Unit Test all failed, should fix UT

@gasvn
Copy link
Contributor Author

gasvn commented Jul 1, 2022

Unit Test all failed, should fix UT

open-mmlab/mmcv#2056

This merge rely on the merge request from mmcv (open-mmlab/mmcv#2056). The Unit Test failed becasue of not using the new mmcv.

@jbwang1997
Copy link
Collaborator

Need to delete the vim temp file configs/rfnext/search_log/convnext_cascade_maskrcnn/.local_search_config_step11.json.swp

@lzyhha
Copy link

lzyhha commented Dec 11, 2022 •
edited
Loading

Hello, I have uploaded all weights and logs. rf-mmdetection-weights @zytx121

@zytx121
Copy link
Collaborator

zytx121 commented Dec 12, 2022

Hello, I have uploaded all weights and logs. rf-mmdetection-weights @zytx121

I will upload it ASAP.

@zytx121
Copy link
Collaborator

zytx121 commented Dec 13, 2022

Hi @lzyhha weights and logs have been upload. Please update links in README.md

prefix = https://download.openmmlab.com/mmdetection/v2.0/rfnext/

  • rfnext_search_panoptic_fpn_r2_50_fpn_fp16_1x_coco/rfnext_search_panoptic_fpn_r2_50_fpn_fp16_1x_coco-34a893a0.pth
  • rfnext_search_panoptic_fpn_r2_50_fpn_fp16_1x_coco/rfnext_search_panoptic_fpn_r2_50_fpn_fp16_1x_coco_20221114_224722.log.json
  • rfnext_search_cascade_mask_rcnn_r2_101_fpn_20e_coco/rfnext_search_cascade_mask_rcnn_r2_101_fpn_20e_coco-e17510a0.pth
  • rfnext_search_cascade_mask_rcnn_r2_101_fpn_20e_coco/rfnext_search_cascade_mask_rcnn_r2_101_fpn_20e_coco_20220327_221419.log.json
  • rfnext_search_cascade_mask_rcnn_hrnetv2p_w18_20e_coco/rfnext_search_cascade_mask_rcnn_hrnetv2p_w18_20e_coco-7b9c7885.pth
  • rfnext_search_cascade_mask_rcnn_hrnetv2p_w18_20e_coco/rfnext_search_cascade_mask_rcnn_hrnetv2p_w18_20e_coco_20221115_230113.log.json
  • rfnext_search_cascade_mask_rcnn_convnext_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco_in1k/rfnext_search_cascade_mask_rcnn_convnext_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco_in1k-f47db42b.pth
  • rfnext_search_cascade_mask_rcnn_convnext_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco_in1k/rfnext_search_cascade_mask_rcnn_convnext_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco_in1k_20220128_200900.log.json
  • rfnext_fixed_single_branch_panoptic_fpn_r2_50_fpn_fp16_1x_coco/rfnext_fixed_single_branch_panoptic_fpn_r2_50_fpn_fp16_1x_coco-52181d5b.pth
  • rfnext_fixed_single_branch_panoptic_fpn_r2_50_fpn_fp16_1x_coco/rfnext_fixed_single_branch_panoptic_fpn_r2_50_fpn_fp16_1x_coco_20221115_152436.log.json
  • rfnext_fixed_single_branch_mask_rcnn_pvtv2-b0_fpn_1x_coco/rfnext_fixed_single_branch_mask_rcnn_pvtv2-b0_fpn_1x_coco-7b25d72e.pth
  • rfnext_fixed_single_branch_mask_rcnn_pvtv2-b0_fpn_1x_coco/rfnext_fixed_single_branch_mask_rcnn_pvtv2-b0_fpn_1x_coco_20221120_213845.log.json
  • rfnext_fixed_single_branch_cascade_mask_rcnn_r2_101_fpn_20e_coco/rfnext_fixed_single_branch_cascade_mask_rcnn_r2_101_fpn_20e_coco-e22d5257.pth
  • rfnext_fixed_single_branch_cascade_mask_rcnn_r2_101_fpn_20e_coco/rfnext_fixed_single_branch_cascade_mask_rcnn_r2_101_fpn_20e_coco_20220402_141321.log.json
  • rfnext_fixed_single_branch_cascade_mask_rcnn_hrnetv2p_w18_20e_coco/rfnext_fixed_single_branch_cascade_mask_rcnn_hrnetv2p_w18_20e_coco-682f121d.pth
  • rfnext_fixed_single_branch_cascade_mask_rcnn_hrnetv2p_w18_20e_coco/rfnext_fixed_single_branch_cascade_mask_rcnn_hrnetv2p_w18_20e_coco_20221118_141400.log.json
  • rfnext_fixed_single_branch_cascade_mask_rcnn_convnext_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco_in1k/rfnext_fixed_single_branch_cascade_mask_rcnn_convnext_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco_in1k-71aeb991.pth
  • rfnext_fixed_single_branch_cascade_mask_rcnn_convnext_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco_in1k/rfnext_fixed_single_branch_cascade_mask_rcnn_convnext_tiny_patch4_window7_mstrain_480-800_giou_4conv1f_adamw_3x_coco_in1k_20220131_091748.log.json

@lzyhha
Copy link

lzyhha commented Dec 13, 2022 •
edited
Loading

Thank you very much.
But sorry I found out that I forgot to upload the weight and log of panoptic_fpn_r2_50_fpn_fp16_1x_coco, which is the baseline of rfnext_search_panoptic_fpn_r2_50_fpn_fp16_1x_coco.

So sorry to have to trouble you to upload it again. I will upload it immediately. @zytx121

@lzyhha
Copy link

lzyhha commented Dec 13, 2022

log and weight of panoptic_fpn_r2_50_fpn_fp16_1x_coco @zytx121

log

weight

@lzyhha
Copy link

lzyhha commented Dec 14, 2022

I have updated the links, except panoptic_fpn_r2_50_fpn_fp16_1x_coco. @zytx121

@lzyhha
Copy link

lzyhha commented Dec 15, 2022

Could you upload these two files? @zytx121

@zytx121
Copy link
Collaborator

zytx121 commented Dec 19, 2022

@lzyhha Sorry, this upload took a little longer.

@lzyhha
Copy link

lzyhha commented Dec 19, 2022

Thanks. And I have updated all links.

zytx121
zytx121 approved these changes Dec 19, 2022
View reviewed changes
Copy link
Collaborator

@zytx121 zytx121 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

jbwang1997
jbwang1997 approved these changes Dec 19, 2022
View reviewed changes
Copy link
Collaborator

@jbwang1997 jbwang1997 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@ZwwWayne ZwwWayne merged commit c02c63b into open-mmlab:dev Dec 22, 2022
thmegy pushed a commit to thmegy/mmdetection that referenced this pull request May 5, 2023
@gasvn @lzyhha @jbwang1997
Support receptive field search of CNN models. (TPAMI paper rf-next) (o…
fbdf9dc 
…pen-mmlab#8191)

* support rfsearch and convnext

* update config and readme for rfnext

* update config path

* update config path

* format readme

* rm convnext

* revise script

* rm extra import of mmcv

* fix model init on new mmdet version

* update config files

* update code

* update code

* update code

* update readme

* panoptic

* hrnet config

* update pre-commit

* solve conflicts

* solve conflicts

* merge

* update code following rf-mmcv

* Update configs/rfnext/README.md

Co-authored-by: jbwang1997 <jbwang1997@gmail.com>

* change config link to openmmlab

* initlize rf-next in train and test

* add rfnext metafile

* README

* add Collections

* add model-index

* add model and log links

* add modelzoo

* Update README.md

* Update README.md

* fix lint

* update links in metafile

Co-authored-by: Zhongyu Li <44114862+lzyhha@users.noreply.github.com>
Co-authored-by: lzyhha <819814373@qq.com>
Co-authored-by: jbwang1997 <jbwang1997@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@lzyhha lzyhha lzyhha left review comments

@jbwang1997 jbwang1997 jbwang1997 approved these changes

@zytx121 zytx121 zytx121 approved these changes

Assignees

@jbwang1997 jbwang1997

Labels
None yet
Projects
None yet
Milestone
2.27.0
Development

Successfully merging this pull request may close these issues.
8 participants
@gasvn @CLAassistant @shinya7y @jbwang1997 @BIGWangYuDong @lzyhha @zytx121 @ZwwWayne