Skip to content

Commit

Permalink
remove quotes in code example (#29812)
Browse files Browse the repository at this point in the history
Co-authored-by: Johannes <johannes.kolbe@tech.better.team>
  • Loading branch information
johko and Johannes authored Mar 25, 2024
1 parent e3e16dd commit 7eb3ba8
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/source/en/model_doc/llava_next.md
Original file line number Diff line number Diff line change
Expand Up @@ -107,7 +107,7 @@ from transformers import LlavaNextForConditionalGeneration, BitsAndBytesConfig
quantization_config = BitsAndBytesConfig(
load_in_4bit=True,
bnb_4bit_quant_type="nf4",
bnb_4bit_compute_dtype="torch.float16",
bnb_4bit_compute_dtype=torch.float16,
)

model = LlavaNextForConditionalGeneration.from_pretrained("llava-hf/llava-v1.6-mistral-7b-hf", quantization_config=quantization_config, device_map="auto")
Expand Down

0 comments on commit 7eb3ba8

Please sign in to comment.