Can't find the xformers.componenets Activations

[asahni04]

❓ Questions and Help

hi i was using the 0.0.28 version but had to recently bump to 0.0.29.post1. i can't find the Activation class to use the Fused GeLU etc
i used to use Fused GeLU with the followup API. is it deprecated? what alternative do i do if it is?

from xformers.components.activations import Activation
self.net = xformers.components.feedforward.MLP(
            dim, drop_units, Activation.GeLU, mult, use_bias
        )

[lw]

Take a look at the answers in #1194, and at #848.