[KNOWN BUG] gguf + GPU AOTI Inference bug due to PT version, fix in progress #1423
Labels
bug
Something isn't working
CI Infra
Issues related to CI infrastructure and setup
Compile / AOTI
Issues related to AOT Inductor and torch compile
Known Gaps
These are known Gaps/Issues/Bug items in torchchat
Quantization
Issues related to Quantization or torchao
triaged
This issue has been looked at a team member, and triaged and prioritized into an appropriate module
🐛 Describe the bug
As of #1367,
torchchat/main
is failing 3-5 CI jobs related to GPU AOTI inference and GGUF inferenceGPU AOTI inference will be fixed with a pinbump to pytorch/pytorch#143236
GGUF AO bug is being addressed in #1404
Versions
bb72b09
The text was updated successfully, but these errors were encountered: