Skip to content

Commit

Permalink
always trust remote code
Browse files Browse the repository at this point in the history
  • Loading branch information
PanQiWei committed Apr 25, 2023
1 parent cfcba7d commit 419160b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion auto_gptq/modeling/_base.py
Original file line number Diff line number Diff line change
Expand Up @@ -357,7 +357,7 @@ def skip(*args, **kwargs):

transformers.modeling_utils._init_weights = False
torch.set_default_dtype(torch.half)
model = AutoModelForCausalLM.from_config(config)
model = AutoModelForCausalLM.from_config(config, trust_remote_code=True)
torch.set_default_dtype(torch.float)
model = model.eval()
layers = find_layers(model)
Expand Down

0 comments on commit 419160b

Please sign in to comment.