can this one bed executed without flashattention?

[4eJIoBek1]

flash-attention is implemented for only ampere and newer gpus, also it blocks code from using on cpu, which is not good

[oliverban]

I have a 3090 so Flash-atten should work according to https://pypi.org/project/flash-attn/ but I still can't install it on my Windows machine, any luck?

[jaykup1]

I have a 3090 so Flash-atten should work according to https://pypi.org/project/flash-attn/ but I still can't install it on my Windows machine, any luck?

#3 (comment)

[oliverban]

I have a 3090 so Flash-atten should work according to https://pypi.org/project/flash-attn/ but I still can't install it on my Windows machine, any luck?

#3 (comment)

Thank you!