feat: check stability of output

[pommedeterresautee]

fix #170

Sometimes we have bugs on masks, or race condition issues.
They may be catched by checking if the output of the kernel change in time or not.
This is inspired from https://github.com/HazyResearch/flash-attention/blob/main/tests/test_flash_attn.py#L978
The loop is smaller to not make tests too slow

Moreover, old implementations are removed as our kernel is now quite different, old implementations are of little value and make tests slower.

[pommedeterresautee]

❯ pytest test/test_attention.py
===================================================================================================== test session starts =====================================================================================================
platform linux -- Python 3.9.15, pytest-7.2.0, pluggy-1.0.0
rootdir: /mnt/workspace/kernl
plugins: anyio-3.6.1
collected 699 items                                                                                                                                                                                                           

test/test_attention.py ................................................................................................................................................................................................ [ 27%]
....................................................................................................................................................................................................................... [ 58%]
....................................................................................................................................................................................................................... [ 88%]
.............................................................................                                                                                                                                           [100%]
...
=============================================================================================== 699 passed in 723.90s (0:12:03) ===============================================================================================

[gaetansnl]

single comment