[Feature]: Add transformer base class (#892)

* add transformer base class * fix according to commments * resiger module * change to use basemodule * add _ between build function * split the name
open-mmlab · Mar 25, 2021 · a9803da · a9803da
1 parent 5f5e8e8
commit a9803da
Show file tree

Hide file tree

Showing 2 changed files with 479 additions and 0 deletions.
diff --git a/mmcv/cnn/bricks/registry.py b/mmcv/cnn/bricks/registry.py
@@ -6,3 +6,8 @@
 PADDING_LAYERS = Registry('padding layer')
 UPSAMPLE_LAYERS = Registry('upsample layer')
 PLUGIN_LAYERS = Registry('plugin layer')
+
+POSITIONAL_ENCODING = Registry('Position encoding')
+ATTENTION = Registry('Attention')
+TRANSFORMER_LAYER = Registry('TransformerLayer')
+TRANSFORMER_LAYER_SEQUENCE = Registry('TransformerLayerSequence')