Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[Feature] Add connector components and FitNet #212

Merged
merged 6 commits into from
Jul 28, 2022
Merged

[Feature] Add connector components and FitNet #212

merged 6 commits into from
Jul 28, 2022

Conversation

wilxy
Copy link
Contributor

@wilxy wilxy commented Jul 28, 2022

New Features

  1. Add connector components. Connector is mainly used for distillation, it usually converts the channel number of input feature to align features of student and teacher. In this PR, BaseConnector and three general connectors (SingleConvConnector, ConvBNConnector and ConvBNReLUConnector) are added.

  2. ConfigurableDistiller adds two connector related parameters ( student_connectors and teacher_connectors) and function build_connectors to build connectors.

  3. Add FitNet distillation algorithm and its README (where the model and log paths are empty, waiting for the training results of the unified benchmark before the release).

  4. Add L2Loss. It can be used as the following example.
    from mmrazor.models import L2Loss
    loss_cfg = dict(loss_weight=10, normalize=False)
    l2loss = L2Loss(**loss_cfg)

Improvement

  1. Add student_trainable parameter in SingleTeacherDistill to control whether the student model is trainable.

  2. Add calculate_student_loss attribute in SingleTeacherDistill to control whether the original task loss to be calculated and used to update student model.

  3. Add test_connectors and test_losses in tests/test_models.

wilxy and others added 6 commits July 26, 2022 21:13
@wilxy
Fix spelling mistakes
6ee68fe
@wilxy
1.Rename general connectors. 2.Replace nn.conv2 to build_conv_layer, …
1b17505 
…replace nn.bn to build_norm_layer.
@wilxy
1. Rename function init_parameters to init_weights in SingleConvConne…
f226c9e 
…ctor to realize automatically invocation.
@wilxy
1. Add norm_cfg in config and general_connector
a8fb03e
@wilxy
1.Move calculate_student_loss to distillation algorithm. 2.Move mmraz…
cbcd8a3 
…or.models.connector to mmrazor.models.architectures. 3.Merge stu_connectors and tea_connectors into connectors, and call connectors by their connector_name.
1.Replace connector_name to connector in record_info. 2.Add assert th…
d75d120 
…at each connector must be in connectors.
@wilxy wilxy requested review from sunnyxiaohu and pppppM July 28, 2022 11:14
@wilxy wilxy changed the title Dev 1.x [Feature] Add connector components and FitNet Jul 28, 2022
@pppppM pppppM merged commit a94aaba into open-mmlab:dev-1.x Jul 28, 2022
humu789 pushed a commit to humu789/mmrazor that referenced this pull request Feb 13, 2023
@grimoire @SingleZombie
@RunningLeon @VVsssssk @AllentDan @hanrui1sensetime
[Refactor] Refactor codebase (open-mmlab#220)
3a785f1 
* [WIP] Refactor v2.0 (open-mmlab#163)

* Refactor backend wrapper

* Refactor mmdet.inference

* Fix

* merge

* refactor utils

* Use deployer and deploy_model to manage pipeline

* Resolve comments

* Add a real inference api function

* rename wrappers

* Set execute to private method

* Rename deployer deploy_model

* Refactor task

* remove type hint

* lint

* Resolve comments

* resolve comments

* lint

* docstring

* [Fix]: Fix bugs in details in refactor branch (open-mmlab#192)

* [WIP] Refactor v2.0 (open-mmlab#163)

* Refactor backend wrapper

* Refactor mmdet.inference

* Fix

* merge

* refactor utils

* Use deployer and deploy_model to manage pipeline

* Resolve comments

* Add a real inference api function

* rename wrappers

* Set execute to private method

* Rename deployer deploy_model

* Refactor task

* remove type hint

* lint

* Resolve comments

* resolve comments

* lint

* docstring

* Fix errors

* lint

* resolve comments

* fix bugs

* conflict

* lint and typo

* Resolve comment

* refactor mmseg (open-mmlab#201)

* support mmseg

* fix docstring

* fix docstring

* [Refactor]: Get the count of backend files (open-mmlab#202)

* Fix backend files

* resolve comments

* lint

* Fix ncnn

* [Refactor]: Refactor folders of mmdet (open-mmlab#200)

* Move folders

* lint

* test object detection model

* lint

* reset changes

* fix openvino

* resolve comments

* __init__.py

* Fix path

* [Refactor]: move mmseg (open-mmlab#206)

* [Refactor]: Refactor mmedit (open-mmlab#205)

* feature mmedit

* edit2.0

* edit

* refactor mmedit

* fix __init__.py

* fix __init__

* fix formai

* fix comment

* fix comment

* Fix wrong func_name of ConvFCBBoxHead (open-mmlab#209)

* [Refactor]: Refactor mmdet unit test (open-mmlab#207)

* Move folders

* lint

* test object detection model

* lint

* WIP

* remove print

* finish unit test

* Fix tests

* resolve comments

* Add mask test

* lint

* resolve comments

* Refine cfg file

* Move files

* add files

* Fix path

* [Unittest]: Refine the unit tests in mmdet open-mmlab#214

* [Refactor] refactor mmocr to mmdeploy/codebase (open-mmlab#213)

* refactor mmocr to mmdeploy/codebase

* fix docstring of show_result

* fix docstring of visualize

* refine docstring

* replace print with logging

* refince codes

* resolve comments

* resolve comments

* [Refactor]: mmseg  tests (open-mmlab#210)

* refactor mmseg tests

* rename test_codebase

* update

* add model.py

* fix

* [Refactor] Refactor mmcls and the package (open-mmlab#217)

* refactor mmcls

* fix yapf

* fix isort

* refactor-mmcls-package

* fix print to logging

* fix docstrings according to others comments

* fix comments

* fix comments

* fix allentdans comment in pr215

* remove mmocr init

* [Refactor] Refactor mmedit tests (open-mmlab#212)

* feature mmedit

* edit2.0

* edit

* refactor mmedit

* fix __init__.py

* fix __init__

* fix formai

* fix comment

* fix comment

* buff

* edit test and code refactor

* refactor dir

* refactor tests/mmedit

* fix docstring

* add test coverage

* fix lint

* fix comment

* fix comment

* Update typehint (open-mmlab#216)

* update type hint

* update docstring

* update

* remove file

* fix ppl

* Refine get_predefined_partition_cfg

* fix tensorrt version > 8

* move parse_cuda_device_id to device.py

* Fix cascade

* onnx2ncnn docstring

Co-authored-by: Yifan Zhou <singlezombie@163.com>
Co-authored-by: RunningLeon <maningsheng@sensetime.com>
Co-authored-by: VVsssssk <88368822+VVsssssk@users.noreply.github.com>
Co-authored-by: AllentDan <41138331+AllentDan@users.noreply.github.com>
Co-authored-by: hanrui1sensetime <83800577+hanrui1sensetime@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@sunnyxiaohu sunnyxiaohu Awaiting requested review from sunnyxiaohu

@pppppM pppppM Awaiting requested review from pppppM

Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@wilxy @pppppM