Skip to content

Issues: huggingface/optimum-quanto

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

20 Open 117 Closed
20 Open 117 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Clarification on Per-Channel vs. Per-Tensor Quantization for Weights and Activations
#356 opened Nov 24, 2024 by kirkdort44
QuantizedModelForCausalLM lost repr, cannot see model structure
#355 opened Nov 23, 2024 by imba-tjd
reload quantized model after saving
#354 opened Nov 21, 2024 by lucienfostier
1
Is it GPU Compatability Issue?
#353 opened Nov 15, 2024 by kamrul-NSL
task not support: image-text-to-text.
#352 opened Nov 14, 2024 by fangyangci
Its not an issue! Quantization Granularity Question
#351 opened Nov 13, 2024 by ClaraLovesFunk
Quantized Flux pipeline to cuda?
#348 opened Nov 9, 2024 by squewel
1
Weights Still in FP32 after Quantization
#347 opened Nov 6, 2024 by ClaraLovesFunk
4
How to support activation 4bit quantization?
#346 opened Nov 4, 2024 by Ther-nullptr
1
Only random noise is generated with Flux + LoRA with optimum-quanto >= 0.2.5
#343 opened Oct 30, 2024 by nelapetrzelkova
2
Inference Speed Slowdown with Static Quantization
#340 opened Oct 29, 2024 by ClaraLovesFunk
2
Corrupted outputs with Marlin int4 kernels as parallelization increases bug Something isn't working help wanted Extra attention is needed
#332 opened Oct 6, 2024 by dacorvo
4
Accuracy issue when using torch._int_mm on AMD CPUs
#319 opened Sep 26, 2024 by dacorvo
5
qint4 failed for diffusers: QBitsTensor cannot be changed
#312 opened Sep 19, 2024 by liyihao1230
2
qin4 inference fails with RuntimeError: Cannot set version_counter for inference tensor
#304 opened Sep 3, 2024 by BenjaminBossan
8
Potential Gradient Error when Reloading Frozen Weights in qmodule.py _load_from_state_dict
#293 opened Aug 24, 2024 by cjfghk5697
4
Support for FP8 Matmuls
#275 opened Aug 9, 2024 by maktukmak
3
Support for new diffuser: flux1.schnell
#272 opened Aug 7, 2024 by KoppAlexander
@dacorvo
6
Packages created on the CI are missing cpp and cuda extension files
#254 opened Jul 23, 2024 by dacorvo
5
QTensor cannot be created from inside a dynamo graph
#46 opened Dec 11, 2023 by dacorvo
9
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.