Definition Attention mechanism

[helpmefindaname]

Referring to the explanation of the attention mechanism in Neural Networks for NLP slide 41

The phrase "the attention mechanism is defined as" suggests that this is the one and only definition of attention, however there are many attention mechanisms. The effect from some is evaluated here.
I'd suggesting rephrasing it to "additive attention is defined as" as that's the commonly used name for the type of attention on that slide, or to describe the mechanism more general by declaring
and noting that one example is

[sebastian-hofstaetter]

Hi,
Thank you very much for the comment - i fixed the slides (I'll update them here once the lecture took place, because i'll move a couple of things around)

Don't forget to mention this at the exercise interview for bonus points :) and keep the suggestions coming!

Best,
Sebastian