v0.1.6.post2

[LeiWang1999]

The Last Release for Python 3.8 (without tvm-ffi) 🚀

What's Changed

• [Analyzer] Enhance ConstIntBoundAnalyzer and IntervalSet with modular set analysis by @LeiWang1999 in [Analyzer] Enhance ConstIntBoundAnalyzer and IntervalSet with modular set analysis #856
• [Doc] Optimize the quickstart guide for clarity and not just for CUDA by @LeiWang1999 in [Doc] Optimize the quickstart guide for clarity and not just for CUDA #858
• [TMA] Bugfix when a shared buffer is both issued with tma store and tma load by @LeiWang1999 in [TMA] Bugfix when a shared buffer is both issued with tma store and tma load #857
• [AMD][MLA] Fix mla autotune for rocm by @LeiWang1999 in [AMD][MLA] Fix mla autotune for rocm #861
• [Bugfix] Ensure correct handling for cases where seq_q<seq_kv in flash attention examples by @Rachmanino in [Bugfix] Ensure correct handling for cases where seq_q<seq_kv in flash attention examples #864
• [AMD] refactor MatrixCoreIntrinEmitter by @Paran0idy in [AMD] refactor MatrixCoreIntrinEmitter #860
• [Feat] Add fast sine and cosine definitions in CUDA templates by @Rachmanino in [Feat] Add fast sine and cosine definitions in CUDA templates #865
• [Layout] Support layout forward with multi dimension by @LeiWang1999 in [Layout] Support layout forward with multi dimension #867
• [Autotune][Conv] optimize convolution examples to use autotune by @LeiWang1999 in [Autotune][Conv] optimize convolution examples to use autotune #866
• [Example] Add examples to support efficient attention sink forward process by @Rachmanino in [Example] Add examples to support efficient attention sink forward process #853
• [Parser] Adapt Parser to work with Python 3.8 in some cases by @LeiWang1999 in [Parser] Adapt Parser to work with Python 3.8 in some cases #869
• [Fix] Fix bug 0905: tilelang doesn't vectorize B[i,j] = c[i] + A[i,j] by @kurisu6912 in [Fix] Fix bug 0905: tilelang doesn't vectorize B[i,j] = c[i] + A[i,j] #798
• [Language] Support sequence comparisons by @LeiWang1999 in [Language] Support sequence comparisons #872
• [Language] Support loop_break primitive by @chengyupku in [Language] Support loop_break primitive #873
• [Bugfix] Use ExprDeepEqual instead of StructuralEqual when merge consecutive If stmt by @LeiWang1999 in [Bugfix] Use ExprDeepEqual instead of StructuralEqual when merge consecutive If stmt #876
• [Language] Support atomic add with ret by @LeiWang1999 in [Language] Support atomic add with ret #870
• [Cython] Remove an incorrect check by @LJC00118 in [Cython] Remove an incorrect check #880
• Update amd_ci.yml by @Alex4210987 in Update amd_ci.yml #881
• [FastMath] Disable default TVM fastmath intrinsic dispatch and add explicit fastmath op to invoke by @LeiWang1999 in [FastMath] Disable default TVM fastmath intrinsic dispatch and add explicit fastmath op to invoke #875
• [Example] Add efficient attention sink backward implementations and tests by @Rachmanino in [Example] Add efficient attention sink backward implementations and tests #877
• [Precision] Introduce T.ieee_rsqrt and related high precision op by @LeiWang1999 in [Precision] Introduce T.ieee_rsqrt and related high precision op #882
• [Dist] Provide an option to include commit ID in version by @LeiWang1999 in [Dist] Provide an option to include commit ID in version #884
• [Example] Optimize sink attention forward via swizzled layout and report benchmark results by @Rachmanino in [Example] Optimize sink attention forward via swizzled layout and report benchmark results #885
• [Layout] Introduce Flexible Parallel to Support T.serial and local buffers inside T.Parallel loop by @LeiWang1999 in [Layout] Introduce Flexible Parallel to Support T.serial and local buffers inside T.Parallel loop #844
• [Bugfix][Enhancement] Fix a bug in previous commit and enhance cuda backend by @Hamerlate in [Bugfix][Enhancement] Fix a bug in previous commit and enhance cuda backend #887
• [Bugfix] Fix CopyNode Lower method to include disable_tma flag in GetCopyInst by @Rachmanino in [Bugfix] Fix CopyNode Lower method to include disable_tma flag in GetCopyInst #888
• [Layout] Fix plot layout by @Paran0idy in [Layout] Fix plot layout #890
• [Example] Add example by @LeiWang1999 in [Example] Add example #894
• [News] Add announcement of support for Huawei Ascend chips by @xwhzz in [News] Add announcement of support for Huawei Ascend chips #895
• [Example] Add sparse mla examples by @LeiWang1999 in [Example] Add sparse mla examples #896
• [Typo] Fix backend name for Huawei Ascend by @xwhzz in [Typo] Fix backend name for Huawei Ascend #898
• [CI] Legalize math related test by @LeiWang1999 in [CI] Legalize math related test #899
• [Bugfix] Fix flops comp and softmax scale in mla by @Edenzzzz in [Bugfix] Fix flops comp and softmax scale in mla  #900
• [Example] Specify a fixed commit for the flash-linear-attention repository and optimize nsa examples by @LeiWang1999 in [Example] Specify a fixed commit for the flash-linear-attention repository and optimize nsa examples #913
• [CI] optimize CI time for sparse gemm by @botbw in [CI] optimize CI time for sparse gemm #906
• [Enhancement] Include compile flags into the hash key of cached kernels by @Rachmanino in [Enhancement] Include compile flags into the hash key of cached kernels #911
• [Bugfix] Fix saving kernel source code where JITKernel.artifact is None by @zjudmd1015 in [Bugfix] Fix saving kernel source code where JITKernel.artifact is None #921
• [CI] Refactor import paths in dequantization examples to use dequantize_utils by @LeiWang1999 in [CI] Refactor import paths in dequantization examples to use dequantize_utils #914
• [Example] Add MLA decode ws example by @chengyupku in [Example] Add MLA decode ws example #928
• [CI] Fix documentation runner by adding 'nvidia' tag by @xwhzz in [CI] Fix documentation runner by adding 'nvidia' tag #927
• [Layout] Strict annotate completed replicated layout for fragment with constant index by @LeiWang1999 in [Layout] Strict annotate completed replicated layout for fragment with constant index #929
• [Bugfix] Fix tensor memory copy layout by @Hamerlate in [Bugfix] Fix tensor memory copy layout #933
• [Example] Optimize online_softmax example by @lijinpei in [Example] Optimize online_softmax example #934
• [Example] Add correctness assert into dsa example by @LeiWang1999 in [Example] Add correctness assert into dsa example #937
• [Enhancement] Enhance and add new GQA backward examples for Hopper by @Rachmanino in [Enhancement] Enhance and add new GQA backward examples for Hopper #930
• [Enhancement] Fix lint to improve grouped GEMM performance with TMA by @Cunxiao2002 in [Enhancement] Fix lint to improve grouped GEMM performance with TMA #938
• [Example] Introduce split+sum template, and optimize atomic_add performance for bwd examples by @LeiWang1999 in [Example] Introduce split+sum template, and optimize atomic_add performance for bwd examples #940
• [Example] Disable TMA and enable FastMath for NSA Examples ([Example] Disable TMA and enable FastMath for NSA Examples (#941) #941) by @LeiWang1999 in [Example] Disable TMA and enable FastMath for NSA Examples (#941) #941
• [Example] Revert the atomic/split&sum templates in MHA backward examples by @Rachmanino in [Example] Revert the atomic/split&sum templates in MHA backward examples #943
• [Example] Add sparse mla bwd example for deepseek_v32 by @Zhichenzzz in [Example] Add sparse mla bwd example for deepseek_v32 #919
• [Profiler]Adds CUPTI profiler support by @Cunxiao2002 in [Profiler]Adds CUPTI profiler support #936
• [Enhancement] Support Copy for Buffer Load witih scalar indices by @LeiWang1999 in [Enhancement] Support Copy for Buffer Load witih scalar indices #946
• [Code Style] Refine nvrtc compile related check style by @BBuf in [Code Style] Refine nvrtc compile related check style #945
• [Backend] Add metal backend by @oraluben in [Backend] Add metal backend #799
• [CI] enable dependabot for GHA workflows by @XuehaiPan in [CI] enable dependabot for GHA workflows #950
• Modify the SM architecture number to support Thor’s sm110. by @iloveai8086 in Modify the SM architecture number to support Thor’s sm110. #957
• [CI] auto-cancel in-progress PR CI when new commits are pushed by @XuehaiPan in [CI] auto-cancel in-progress PR CI when new commits are pushed #956
• [bug] fix type object is not subscriptable in py38 by @BBuf in [bug] fix type object is not subscriptable in py38 #959
• [Bugfix][Doc] Add astroid version constraint to requirements.txt by @xwhzz in [Bugfix][Doc] Add astroid version constraint to requirements.txt #958
• [CI]: Bump actions/setup-python from 2 to 6 by @dependabot[bot] in [CI]: Bump actions/setup-python from 2 to 6 #951
• [CI]: Bump astral-sh/setup-uv from 6 to 7 by @dependabot[bot] in [CI]: Bump astral-sh/setup-uv from 6 to 7 #952
• [CI]: Bump actions/github-script from 7 to 8 by @dependabot[bot] in [CI]: Bump actions/github-script from 7 to 8 #954
• [CI]: Bump actions/checkout from 2 to 5 by @dependabot[bot] in [CI]: Bump actions/checkout from 2 to 5 #953
• [TileOp] Implement WGMMA for T.gemm_v2 by @LeiWang1999 in [TileOp] Implement WGMMA for T.gemm_v2 #813
• [Docs] add CODE_OF_CONDUCT.md by @XuehaiPan in [Docs] add CODE_OF_CONDUCT.md #965
• [Example] Add support for bfloat16 and user-defined sm_scale in attention sink examples by @Rachmanino in [Example] Add support for bfloat16 and user-defined sm_scale in attention sink examples #924
• [Bugfix] Do not force inline let stmt by @LeiWang1999 in [Bugfix] Do not force inline let stmt #947
• [CI] add pre-commit integration by @XuehaiPan in [CI] add pre-commit integration #955
• [Doc] Install docs add docker install method by @BBuf in [Doc] Install docs add docker install method #961
• [Bugfix] Fix dummy kernel compliation by @SiriusNEO in [Bugfix] Fix dummy kernel compliation #962
• [CI][Refactor] Refactor non-test CI workflow files by @XuehaiPan in [CI][Refactor] Refactor non-test CI workflow files #971
• [TileOp] Implememt CumSum1D by @LeiWang1999 in [TileOp] Implememt CumSum1D #978
• [Language] Enhance T.alloc_var for AugAssign and AnnAsign by @LeiWang1999 in [Language] Enhance T.alloc_var for AugAssign and AnnAsign #979
• [Refactor] Refactor Pass InjectFenceProxy and expose some warp group primitives in frontend by @LeiWang1999 in [Refactor] Refactor Pass InjectFenceProxy and expose some warp group primitives in frontend #977
• [Typo] Remove debug print by @LeiWang1999 in [Typo] Remove debug print #980
• [Bugfix] Use access_ptr("r") instead of access_ptr("w") for correct pipeline analysis by @LeiWang1999 in [Bugfix] Use access_ptr("r") instead of access_ptr("w") for correct pipeline analysis #983
• [Feature][Example] Support TMA reduce operation and update GQA bwd example by @chengyupku in [Feature][Example] Support TMA reduce operation and update GQA bwd example #969
• [Bugfix] Add NVIDIA HPC SDK support in CUDA detection (Add support for NVIDIA HPC SDK (nvhpc) installation paths #974) by @Degeneracy-Evil in [Bugfix] Add NVIDIA HPC SDK support in CUDA detection (#974) #976
• [BugFix] Robust gemm policy for sparse_mla_fwd in Hopper and Ada Lovelace architectures by @tzj-fxz in [BugFix] Robust gemm policy for sparse_mla_fwd in Hopper and Ada Lovelace architectures #984
• [Bugfix] Fallback torch.accelerator.synchronize() to torch.cuda.synchronize() by @yyttt6 in [Bugfix] Fallback torch.accelerator.synchronize() to torch.cuda.synchronize() #987
• [Bugfix]:Fix atomicadd auto vectorize identify var error by @yyttt6 in [Bugfix]:Fix atomicadd auto vectorize identify var error #883
• [CI] Speed up sparse tensor core test via vectorized generating sparse data by @LeiWang1999 in [CI] Speed up sparse tensor core test via vectorized generating sparse data #1009
• [Build] Migrate to scikit-build-core by @oraluben in [Build] Migrate to scikit-build-core #939
• [CI] Removes redundant environment variable by @Cunxiao2002 in [CI] Removes redundant environment variable  #1020
• [Transform] Migrate LowerIntrin from tvm into tilelang by @LeiWang1999 in [Transform] Migrate LowerIntrin from tvm into tilelang #999
• [Lint] Prefer American English spelling by @XuehaiPan in [Lint] Prefer American English spelling #1022
• [Build] Prefer libs from local build dir by @oraluben in [Build] Prefer libs from local build dir #1027
• [Language] Support Consequential assignments like 'a = b = c = 1' by @LeiWang1999 in [Language] Support Consequential assignments like 'a = b = c = 1' #992
• [CI] Removes debug print statements from the example. by @Cunxiao2002 in [CI] Removes debug print statements from the example. #1030
• [Enhancement] Update abs function for half_t and bfloat_t to use cutlass implementation by @Rachmanino in [Enhancement] Update abs function for half_t and bfloat_t to use cutlass implementation #1023
• [Bugfix] Recover code for flexible parallel by @LeiWang1999 in [Bugfix] Recover code for flexible parallel #1032
• [CI] Disable buggy(maybe) warp specialized kernel ci test for H20 by @LeiWang1999 in [CI] Disable buggy(maybe) warp specialized kernel ci test for H20 #1033
• [TIR] Revert some changes of Pass LowerIntrin by @LeiWang1999 in [TIR] Revert some changes of Pass LowerIntrin #1035
• [Env] Optimize the mechanism for locating TL_LIBS by @LeiWang1999 in [Env] Optimize the mechanism for locating TL_LIBS #1038
• [CUDA] Add pack functions for FP8 types by @LJC00118 in [CUDA] Add pack functions for FP8 types #967
• [Language] Expose T.get_warp_idx_sync and T.shuffle_elect for efficient thread election by @LeiWang1999 in [Language] Expose T.get_warp_idx_sync and T.shuffle_elect for efficient thread election #989
• [AMD] fix bug&add amd fp8 examples by @Alex4210987 in [AMD] fix bug&add amd fp8 examples #966
• [CI][Refactor] Merge test CI workflow files into one by @XuehaiPan in [CI][Refactor] Merge test CI workflow files into one #973
• [BugFix] Phaseout dependency of Triton in sink examples to make CI happy by @Rachmanino in [BugFix] Phaseout dependency of Triton in sink examples to make CI happy #1045
• [Refactor] Use has_simt_copy to decide whether to insert set_max_nreg by @chengyupku in [Refactor] Use has_simt_copy to decide whether to insert set_max_nreg #982
• [Feature]: Add test for atomicadd auto vectorize and remove useless code by @yyttt6 in [Feature]: Add test for atomicadd auto vectorize and remove useless code #1019
• Allow mma gemm for all cuda arch by @oraluben in Allow mma gemm for all cuda arch #1047
• [Bugfix] Improves compatibility when checking for MPS availability in different PyTorch builds. by @LeiWang1999 in [Bugfix] Improves compatibility when checking for MPS availability in different PyTorch builds. #1051
• [CI] Fix ROCm CI by @XuehaiPan in [CI] Fix ROCm CI #1043
• [Enhancement] Add support for symbolic dimensions in Cython kernel adapter and improve static shape validation in wrapper by @Rachmanino in [Enhancement] Add support for symbolic dimensions in Cython kernel adapter and improve static shape validation in wrapper #1024
• Automatically initialize submodule if missing by @LeiWang1999 in Automatically initialize submodule if missing #1052
• [Enhancement] Remove constraint requiring last dimension stride to be 1 by @LJC00118 in [Enhancement] Remove constraint requiring last dimension stride to be 1 #1040
• [CI] Disable autofix for pre-commit CI by @LeiWang1999 in [CI] Disable autofix for pre-commit CI #1053
• [Enhancement] Improve CUDA compiler detection in CMake by @LJC00118 in [Enhancement] Improve CUDA compiler detection in CMake #1054
• [Enhancement] Introduce a workaround for layout inference for local buffer store by @LeiWang1999 in [Enhancement] Introduce a workaround for layout inference for local buffer store #1055
• [Refactor] Refactor Pass LegalizeSafeMemoryAccess to support recursive load/store rewrite by @SiriusNEO in [Refactor] Refactor Pass LegalizeSafeMemoryAccess to support recursive load/store rewrite #1050
• Making version parser more robust against missing or unavailable metadata by @LeiWang1999 in Making version parser more robust against missing or unavailable metadata #1061
• [DOC] Add document for develop with PYTHONPATH by @LeiWang1999 in [DOC] Add document for develop with PYTHONPATH #1062
• [CI]:Reduce test shapes to avoid OOM errors during CI. by @yyttt6 in [CI]:Reduce test shapes to avoid OOM errors during CI. #1060
• [Benchmark] Add H800 SXM Benchmark results by @LeiWang1999 in [Benchmark] Add H800 SXM Benchmark results #1063
• [Misc] Add GitHub issue templates by @XuehaiPan in [Misc] Add GitHub issue templates #1057
• [Refactor][Example] Update linear attention examples and add tests by @Rachmanino in [Refactor][Example] Update linear attention examples and add tests #1010
• [Enhancement] Deprecate split&sum in attn bwd examples on Hopper by @Rachmanino in [Enhancement] Deprecate split&sum in attn bwd examples on Hopper #1065
• [Benchmark] Add matmul FP16 benchmark results by @LeiWang1999 in [Benchmark] Add matmul FP16 benchmark results #1067
• [CI]: Bump actions/checkout from 4 to 5 by @dependabot[bot] in [CI]: Bump actions/checkout from 4 to 5 #1070
• [Example] Update GQA varlen fwd and MHA varlen fwd by @chengyupku in [Example] Update GQA varlen fwd and MHA varlen fwd #1071
• [Parallel] Support T.Parallel with dynamic extents by @LeiWang1999 in [Parallel] Support T.Parallel with dynamic extents #990
• [Layout] Utilizing IsEqual instead of StructuralEqual by @LeiWang1999 in [Layout] Utilizing IsEqual instead of StructuralEqual #1073
• [Cache] raise errors for tileang.clear_cache() by @LeiWang1999 in [Cache] raise errors for tileang.clear_cache() #1077
• [Feature] Support Reduce operators for bitwise and/or/xor by @tzj-fxz in [Feature] Support Reduce operators for bitwise and/or/xor #1074
• [Autotune] Add autotune coverage for symbolic M and normalize cache key by @LeiWang1999 in [Autotune] Add autotune coverage for symbolic M and normalize cache key #1075
• [Language] Recommend using T.dynamic instead of T.symbolic by @LeiWang1999 in [Language] Recommend using T.dynamic instead of T.symbolic #1076
• [Language] Efficient T.reduce_ with shared memory input/output by @LeiWang1999 in [Language] Efficient T.reduce_ with shared memory input/output #1080
• [Bugfix] Fix missing reg alloc in custom warp specialization by @chengyupku in [Bugfix] Fix missing reg alloc in custom warp specialization #1084
• [Enhancement] Update async intrinsic handling in inject_fence_proxy by @Rachmanino in [Enhancement] Update async intrinsic handling in inject_fence_proxy #1068
• [Feature] Add GQA backward kernel with varlen input by @tzj-fxz in [Feature] Add GQA backward kernel with varlen input #1082
• [BugFix] Add memory order argument for non-vectorized atomic add by @tzj-fxz in [BugFix] Add memory order argument for non-vectorized atomic add #1081
• [Refactor] Rename cython output to tilelang_cython and relocate its path by @LeiWang1999 in [Refactor] Rename cython output to tilelang_cython and relocate its path #1086
• [Target] Enhance target selection helpers and documentation by @LeiWang1999 in [Target] Enhance target selection helpers and documentation #1085
• [Cleanup] Remove tilelang.disable_cache() calls from examples and tests by @Rachmanino in [Cleanup] Remove tilelang.disable_cache() calls from examples and tests #1088
• [PassConfig] Introduce PassConfig TL_STORAGE_REWRITE_DETECT_INPLACE by @LeiWang1999 in [PassConfig] Introduce PassConfig TL_STORAGE_REWRITE_DETECT_INPLACE #1089
• [Language] Support tilelang alloc_var(dtype, init=x) by @LeiWang1999 in [Language] Support tilelang alloc_var(dtype, init=x)  #1092
• [Bugfix] Fix missing host cuTensorMapEncodeIm2col call by @chengyupku in [Bugfix] Fix missing host cuTensorMapEncodeIm2col call #1094
• [GQA] Add regional atomic add to slightly boost performance by @tzj-fxz in [GQA] Add regional atomic add to slightly boost performance #1093
• [Example] Add block level high performance gemv example by @LeiWang1999 in [Example] Add block level high performance gemv example #1097
• [Refactor] Optimize debug message for parallel inference by @LeiWang1999 in [Refactor] Optimize debug message for parallel inference #1096
• [CI][Lint] Retire format.sh and add clang-tidy to GHA workflow by @XuehaiPan in [CI][Lint] Retire format.sh and add clang-tidy to GHA workflow #1044
• [Refactor] Use forceinline in ldmatrix and update mamba scan kernel by @chengyupku in [Refactor] Use forceinline in ldmatrix and update mamba scan kernel #1104
• [Maint] Update uncommitted change detection command in format.sh by @XuehaiPan in [Maint] Update uncommitted change detection command in format.sh #1102
• [Benchmark] Add Mamba2_chunk_scan benchmark by @chengyupku in [Benchmark] Add Mamba2_chunk_scan benchmark #1109
• [Benchmark] Update Mamba2_chunk_scan benchmark by @chengyupku in [Benchmark] Update Mamba2_chunk_scan benchmark #1110
• [Lint] Enable pyupgrade linter in ruff by @oraluben in [Lint] Enable pyupgrade linter in ruff #963
• [Refactor] Improve scalar handling in CopyNode and update loop partition dtype logi by @LeiWang1999 in [Refactor] Improve scalar handling in CopyNode and update loop partition dtype logi #1111
• [Feature] Enhance vectorized conversion support in CUDA codegen by @Rachmanino in [Feature] Enhance vectorized conversion support in CUDA codegen #1095
• [Feature] Support None type as input for T.ptr and T.Tensor by @xwhzz in [Feature] Support None type as input for T.ptr and T.Tensor #1114
• [Bugfix] Resolve mixed stride dtype issue (inconsistent int32/int64 values) by @LeiWang1999 in [Bugfix] Resolve mixed stride dtype issue (inconsistent int32/int64 values) #1119
• [Feature] Add memory_order PTX for vectorized atomic add by @tzj-fxz in [Feature] Add memory_order PTX for vectorized atomic add #1112
• [CI]: Bump actions/upload-artifact from 4 to 5 by @dependabot[bot] in [CI]: Bump actions/upload-artifact from 4 to 5 #1128
• [CI]: Bump actions/download-artifact from 5 to 6 by @dependabot[bot] in [CI]: Bump actions/download-artifact from 5 to 6 #1127
• [Enhancement] Add missing fence_barrier_init primitive after mbarrier init by @chengyupku in [Enhancement] Add missing fence_barrier_init primitive after mbarrier init #1121
• [Feature]:Add device assert by @yyttt6 in [Feature]:Add device assert #1116
• [Build][CI] Build and test SDist in release CI by @XuehaiPan in [Build][CI] Build and test SDist in release CI #1098
• [Benchmark] Update triton and helion baselines in mamba-chuk-scan by @chengyupku in [Benchmark] Update triton and helion baselines in mamba-chuk-scan #1131
• Add int2 and longlong4 pack functions by @LJC00118 in Add int2 and longlong4 pack functions #1129
• [BugFix] Add memory order and testing script for split version GQA bwd kernel by @tzj-fxz in [BugFix] Add memory order and testing script for split version GQA bwd kernel #1100
• [Bugfix] Correctly construct the argument list for atomic add based on the vector size by @LeiWang1999 in [Bugfix] Correctly construct the argument list for atomic add based on the vector size #1137
• [AMD] Supoort T.gemm_v2 for AMD Backend by @Paran0idy in [AMD] Supoort T.gemm_v2 for AMD Backend #1136
• [BugFix] alloc_var init failed to handle complex expression by @kurisu6912 in [BugFix] alloc_var init failed to handle complex expression #1144
• [Refactor] Remove amd gemm_v2 tests by @LeiWang1999 in [Refactor] Remove amd gemm_v2 tests #1149
• [BugFix] Implement bfloat16 support in CUDA code generation with min/max functions and inf/nan values by @Rachmanino in [BugFix] Implement bfloat16 support in CUDA code generation with min/max functions and inf/nan values #1143
• [Bugfix] Implement classic arena algorithm for shmem merge and WAW conflict detection by @LeiWang1999 in [Bugfix] Implement classic arena algorithm for shmem merge and WAW conflict detection #1146
• [CI] allow dirty workspace for format.sh and introduce loop carry thread sync unit test by @LeiWang1999 in [CI] allow dirty workspace for format.sh and introduce loop carry thread sync unit test #1153
• [CI] use Python urllib to download file instead of Wget by @XuehaiPan in [CI] use Python urllib to download file instead of Wget #1154
• [BugFix] Correct direct copy from bf16 to fp8 by @Cunxiao2002 in [BugFix] Correct direct copy from bf16 to fp8 #1090
• [Refactor]:Move device_assert from extern_call to intrin_call by @yyttt6 in [Refactor]:Move device_assert from extern_call to intrin_call #1134
• [Enhancement] Enhance Cast operations Vectorization by @LJC00118 in [Enhancement] Enhance Cast operations Vectorization #1156
• [Bugfix] Enhance LetStmt handling in Vectorize Loop Pass by @LeiWang1999 in [Bugfix] Enhance LetStmt handling in Vectorize Loop Pass #1159
• [Release] Bump version to v0.1.6.post2 by @LeiWang1999 in [Release] Bump version to v0.1.6.post2 #1160

New Contributors

• @LJC00118 made their first contribution in [Cython] Remove an incorrect check #880
• @Edenzzzz made their first contribution in [Bugfix] Fix flops comp and softmax scale in mla  #900
• @zjudmd1015 made their first contribution in [Bugfix] Fix saving kernel source code where JITKernel.artifact is None #921
• @lijinpei made their first contribution in [Example] Optimize online_softmax example #934
• @Zhichenzzz made their first contribution in [Example] Add sparse mla bwd example for deepseek_v32 #919
• @BBuf made their first contribution in [Code Style] Refine nvrtc compile related check style #945
• @XuehaiPan made their first contribution in [CI] enable dependabot for GHA workflows #950
• @iloveai8086 made their first contribution in Modify the SM architecture number to support Thor’s sm110. #957
• @Degeneracy-Evil made their first contribution in [Bugfix] Add NVIDIA HPC SDK support in CUDA detection (#974) #976

Full Changelog: v0.1.6.post1...v0.1.6.post2

---

This discussion was created from the release v0.1.6.post2.