Skip to content

Conversation

@LeiWang1999
Copy link
Member

This pull request includes several changes to improve code readability and update the project version. The most significant changes include adding a new file to the MANIFEST.in, updating the project version, and improving the formatting of several Python files to enhance readability.

Project Updates:

  • VERSION: Updated the project version from 0.1.0 to 0.1.1.

File Additions:

  • MANIFEST.in: Added tilelang/jit/adapter/cython/cython_wrapper.pyx to the included files.

Code Formatting Improvements:

- Remove TorchCPPKernelAdapter and related code from JIT modules
- Update execution backend options in jit/__init__.py, kernel.py, and adapter/__init__.py
- Remove "torch_cpp" from supported execution backend literals
- Simplify backend validation and remove unused torch_cpp-related code
。
- Implement block sparse attention kernels for TileLang and Triton
- Add example scripts for block sparse attention with top-k and threshold-based masking
- Include utility functions for generating sparse attention masks
- Demonstrate causal attention with block-level sparsity
- Add test cases to validate sparse attention implementations against PyTorch reference
- Apply consistent code formatting and style in TileLang and Triton block sparse attention implementations
- Add ruff linter ignore comment for specific line in Triton implementation
- Improve readability by adjusting indentation and line breaks
- Standardize sparse mask generation and test function implementations
- Minor optimizations in test case configurations
@LeiWang1999 LeiWang1999 merged commit 59342bb into tile-ai:main Feb 23, 2025
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant