[Feature] Support TTA and add --tta in tools/test.py.

[mzr1996]

Motivation

To support Test-Time-Aug (TTA).

Modification

• Add AverageScoreTTAModel inherited from the BaseTTAModel in MMEngine.
• Add --tta option in tools/test.py to enable TTA during the test.

Use cases

To use the default TTA (average the classification scores of images w/ and w/o flip)

python tools/test.py configs/resnet/resnet50_8xb32_in1k.py checkpoints/resnet50_in1k.pth --tta

To use your own custom TTA method

1. Add tta_model and tta_pipeline in your config file:

...
tta_model = dict(type='AverageScoreTTAModel')
tta_pipeline = [
    dict(type='LoadImageFromFile'),
    dict(type='ResizeEdge', scale=384, edge='short'),
    dict(type='CenterCrop', crop_size=384),
    dict(type='TestTimeAug',
         transforms=[
             [
                 dict(type='Resize', scale=224),
                 dict(type='Resize', scale=384)
             ],
             [
                 dict(type='RandomFlip', prob=1.),
                 dict(type='RandomFlip', prob=0.)
             ],
             [dict(type='PackClsInputs')],
         ]),
]

2. test with TTA

python tools/test.py configs/resnet/resnet50_8xb32_in1k.py checkpoints/resnet50_in1k.pth --tta

Checklist

Before PR:

• Pre-commit or other linting tools are used to fix the potential lint issues.
• Bug fixes are fully covered by unit tests, the case that causes the bug should be added in the unit tests.
• The modification is covered by complete unit tests. If not, please add more unit test to ensure the correctness.
• The documentation has been modified accordingly, like docstring or example tutorials.

After PR:

• If the modification has potential influence on downstream or other related projects, this PR should be tested with those projects, like MMDet or MMSeg.
• CLA has been signed and all committers have signed the CLA in this PR.

[codecov]

Codecov Report

Base: 0.02% // Head: 88.60% // Increases project coverage by +88.58% 🎉

Coverage data is based on head (bd31382) compared to base (b8b31e9).
Patch has no changes to coverable lines.

Additional details and impacted files

@@             Coverage Diff              @@
##           dev-1.x    #1161       +/-   ##
============================================
+ Coverage     0.02%   88.60%   +88.58%     
============================================
  Files          121      159       +38     
  Lines         8217    12544     +4327     
  Branches      1368     2005      +637     
============================================
+ Hits             2    11115    +11113     
+ Misses        8215     1098     -7117     
- Partials         0      331      +331     

Flag	Coverage Δ
unittests	88.60% <ø> (+88.58%)	⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files	Coverage Δ
mmcls/datasets/transforms/compose.py
mmcls/models/backbones/swin_transformer_v2.py	89.63% <0.00%> (ø)
mmcls/engine/hooks/switch_recipe_hook.py	88.46% <0.00%> (ø)
mmcls/models/backbones/edgenext.py	95.20% <0.00%> (ø)
mmcls/models/backbones/tinyvit.py	91.20% <0.00%> (ø)
mmcls/models/backbones/efficientformer.py	95.08% <0.00%> (ø)
mmcls/engine/hooks/ema_hook.py	81.69% <0.00%> (ø)
mmcls/models/heads/margin_head.py	89.13% <0.00%> (ø)
mmcls/models/backbones/davit.py	84.94% <0.00%> (ø)
mmcls/engine/optimizers/adan_t.py	10.60% <0.00%> (ø)
... and 150 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

☔ View full report at Codecov.
📢 Do you have feedback about the report comment? Let us know in this issue.

[yingfhu]

Please add UT

[mzr1996]

Please add UT

Done.

[yingfhu]

LGTM

[mzr1996]

This PR depends on open-mmlab/mmengine#611.

[Ezra-Yu]

How to use custom tta needs to be reflected in the config as well as in the documentation, but this can be done later.

[Ezra-Yu]

LGTM.