Skip to content

Commit

Permalink
remove breakpoint
Browse files Browse the repository at this point in the history
  • Loading branch information
gante committed Mar 16, 2023
1 parent ca8162d commit 8ab1a4c
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion src/transformers/models/bloom/modeling_bloom.py
Original file line number Diff line number Diff line change
Expand Up @@ -513,7 +513,6 @@ def _convert_to_standard_cache(
Standardizes the format of the cache so as to match most implementations, i.e. to tuple(tuple([batch_size,
num_heads, ...]))
"""
breakpoint()
batch_size_times_num_heads, head_dim, seq_length = past_key_value[0][0].shape
num_heads = batch_size_times_num_heads // batch_size
# key: [batch_size * num_heads, head_dim, seq_length] -> [batch_size, num_heads, head_dim, seq_length]
Expand Down

0 comments on commit 8ab1a4c

Please sign in to comment.