Commit 716dbef

authored

[Example] Add GQA decoding kernel with varlen page table (#1265)

* [Example] Add page table for gqa decode * [Example] Page table for varlen decoding * [Lint] * [Refactor] Remove redundant code * [Lint] * [Lint] * [Lint]

1 parent 2de566e commit 716dbefCopy full SHA for 716dbef

1 file changed

+711

-0

lines changed

examples/flash_decoding
- example_gqa_decode_varlen_logits_paged.py

1 file changed

+711

-0

lines changed

Comments

(0)

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Commit 716dbef

1 file changed

1 file changed

File tree

1 file changed

1 file changed

0 commit comments