Skip to content

Commit

Permalink
add missing attribute _supports_param_buffer_assignment for gpt-j. (#…
Browse files Browse the repository at this point in the history
…32359)

Co-authored-by: Guoming Zhang <37257613+nv-guomingz@users.noreply.github.com>
  • Loading branch information
nv-guomingz and Guoming Zhang authored Aug 1, 2024
1 parent 48ed24c commit 9e28284
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions src/transformers/models/gptj/modeling_gptj.py
Original file line number Diff line number Diff line change
Expand Up @@ -500,6 +500,7 @@ class GPTJPreTrainedModel(PreTrainedModel):
_no_split_modules = ["GPTJBlock"]
_skip_keys_device_placement = "past_key_values"
_supports_flash_attn_2 = True
_supports_param_buffer_assignment = False

def __init__(self, *inputs, **kwargs):
super().__init__(*inputs, **kwargs)
Expand Down

0 comments on commit 9e28284

Please sign in to comment.