You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The issue is reproducible and needs investigation from dev team, but since we are focusing on the cortex.cpp, I think we can wait until this feature is implemented in the new version of cortex.cpp
freelerobot
changed the title
bug: model quantization selection is gone
bug: can't select model quantizations
Sep 6, 2024
Describe the bug
When pulling a model from HF, I could not select the model quantization, it downloads the first one by default (lowest quality)
To Reproduce
Steps to reproduce the behavior:
cortex
Expected behavior
It should prompt users to select the quantization they want to pull
The text was updated successfully, but these errors were encountered: