Skip to content

Commit 8654736

Browse files
fix typo
1 parent 7c49180 commit 8654736

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

torchtune/modules/kv_cache.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ class KVCache(nn.Module):
1717
Args:
1818
batch_size (int): batch size model will be run with
1919
max_seq_len (int): maximum sequence length model will be run with
20-
num_kv_heads (int): number key/value heads.
20+
num_kv_heads (int): number of key/value heads.
2121
head_dim (int): per-attention head embedding dimension
2222
dtype (torch.dtype): dtype for the caches
2323
"""

0 commit comments

Comments
 (0)