add blog to docs (#10997)

huggingface · Mar 31, 2021 · 01068ab · 01068ab
1 parent cd56f3f
commit 01068ab
Showing 1 changed file with 2 additions and 0 deletions.
diff --git a/docs/source/model_doc/bigbird.rst b/docs/source/model_doc/bigbird.rst
@@ -41,6 +41,8 @@ propose novel applications to genomics data.*
 
 Tips:
 
+- For an in-detail explanation on how BigBird's attention works, see `this blog post
+  <https://huggingface.co/blog/big-bird>`__.
 - BigBird comes with 2 implementations: **original_full** & **block_sparse**. For the sequence length < 1024, using
   **original_full** is advised as there is no benefit in using **block_sparse** attention.
 - The code currently uses window size of 3 blocks and 2 global blocks.