About get_flpos.py

[pengzhiliang]

Hello,
I'd like to know if there is a self-attention module in backbone, is it accurate to use get_flops.py to calculate flops?

[ZwwWayne]

The flop counter relies on the implementation is MMCV here. It seems that multihead attention or customized attention module's FLOP is not included.

[pengzhiliang]

Ok, I find that, thank u~

In fact, if the torch.bmm operator is included, the flops will be accurate.
And, the LayerNorm is also ignored in get_model_complexity_info function.

[ZwwWayne]

Thanks for your suggestion. Would you like to create a PR to MMCV? If not, we may add this feature in MMCV in the next month.

[pengzhiliang]

ooooh! I'm sorry that I don't know how to implement it in fact.

Therefore, looking forward to the update of mmcv !

Thank u~