tl.dot updated https://github.com/openai/triton/issues/1098

[bmedishe]

I got this error when trying to run stable_diffusion inference with deepspeed
TypeError: dot() got an unexpected keyword argument 'trans_b'

Issue found on triton with the same error : TypeError: dot() got an unexpected keyword argument 'trans_b'
solution suggested was to use qk += tl.dot(q, tl.trans(k)) , inplace of qk += tl.dot(q, k, trans_b=True)

[mrwyattii]

@bmedishe have you tested this with a stable diffusion model? It causes DeepSpeed to hang for me.

[bmedishe]

@bmedishe have you tested this with a stable diffusion model? It causes DeepSpeed to hang for me.

@mrwyattii Hi , I see a hang on AMD GPU too, what version of triton should I be using to have working
qk += tl.dot(q, k, trans_b=True)
After this PR Merge triton-mlir branch - Complete rewrite of the backend from scratch qk += tl.dot(q, k, trans_b=True) throws TypeError

[abhijitpal1247]

I am facing the same issue, any updates?

[DEQDON]

Same here. This fix hangs on Nvidia RTX 3090.

[mrwyattii]

@mrwyattii Hi , I see a hang on AMD GPU too, what version of triton should I be using to have working qk += tl.dot(q, k, trans_b=True)

DeepSpeed/requirements/requirements-sd.txt

Line 2 in d925395

triton==2.0.0.dev20221202