Skip to content

[CK_TILE][FMHA] Support page size 16 for batch prefill kernel#1850

Merged
valarLip merged 3 commits intomainfrom
batch_prefill_page_size_16_vectorized
Jan 17, 2026
Merged

[CK_TILE][FMHA] Support page size 16 for batch prefill kernel#1850
valarLip merged 3 commits intomainfrom
batch_prefill_page_size_16_vectorized

Conversation

@Jeff-Huang
Copy link
Contributor

Motivation

  • Enable support for page_size=16 in the FMHA batch prefill kernel.
  • Add tests for page size 16.

Technical Details

Test Plan

Test Result

Submission Checklist

@Jeff-Huang Jeff-Huang requested a review from a team January 15, 2026 14:14
@Jeff-Huang Jeff-Huang force-pushed the batch_prefill_page_size_16_vectorized branch from 3dd24df to 904a4e8 Compare January 16, 2026 02:15
@Jeff-Huang Jeff-Huang force-pushed the batch_prefill_page_size_16_vectorized branch from 904a4e8 to ed8e2cd Compare January 16, 2026 03:34
@valarLip valarLip merged commit b738b1b into main Jan 17, 2026
22 of 23 checks passed
@valarLip valarLip deleted the batch_prefill_page_size_16_vectorized branch January 17, 2026 01:26
yzhou103 pushed a commit that referenced this pull request Jan 28, 2026
* [CK_TILE][FMHA] Support page size 16 for batch prefill kernel

* handle GQA cases in reference outputs.

---------

Co-authored-by: Lingpeng Jin <103567126+valarLip@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants