Skip to content

Commit 72cb937

Browse files
committed
update doc
Signed-off-by: ganyi <ygan@amd.com>
1 parent e10803b commit 72cb937

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/v1/attention/backends/utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -96,7 +96,7 @@ class ReorderSpec:
9696
Case 2: decode_threshold=3, split_extend=True,
9797
query_len: [3, 1, 2, 2, 7, 15, 10, 5, 8]
9898
seq_len: [8, 9, 8, 10, 10, 20, 10, 5, 8]
99-
└────── dec ──────┘ └─ext─┘ └pre┘
99+
└──── dec ────┘ └─ext─┘ └pre┘
100100
→ Reordered as [decode, extend_prefill, pure_prefill].
101101
102102
Case 3 (Future/TODO):

0 commit comments

Comments
 (0)