Skip to content

Commit e10803b

Browse files
committed
update doc
Signed-off-by: ganyi <ygan@amd.com>
1 parent d4190f6 commit e10803b

File tree

1 file changed

+3
-3
lines changed

1 file changed

+3
-3
lines changed

vllm/v1/attention/backends/utils.py

Lines changed: 3 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -94,9 +94,9 @@ class ReorderSpec:
9494
→ Reordered as [decode, prefill].
9595
9696
Case 2: decode_threshold=3, split_extend=True,
97-
query_len: [3, 1, 2, 2, 7, 15, 10, 5]
98-
seq_len: [8, 9, 8, 10, 10, 20, 10, 5]
99-
└────── dec ──────┘ext ─┘└pre┘
97+
query_len: [3, 1, 2, 2, 7, 15, 10, 5, 8]
98+
seq_len: [8, 9, 8, 10, 10, 20, 10, 5, 8]
99+
└────── dec ──────┘ └─ext─┘ └pre┘
100100
→ Reordered as [decode, extend_prefill, pure_prefill].
101101
102102
Case 3 (Future/TODO):

0 commit comments

Comments
 (0)