[CI Failure]: Quantized Models Test - models/quantization/test_gguf.py::test_models

[Isotr0py]

Name of failing test

Quantized Models Test - models/quantization/test_gguf.py::test_models

Basic information

• Flaky test
• Can reproduce locally
• Caused by external libraries (e.g. bug in transformers)

🧪 Describe the failing test

Error message:

  | [2025-08-02T17:58:21Z] FAILED models/quantization/test_gguf.py::test_models[1-5-32-half-model0] - OSError: It looks like the config file at '/fsx/hf_cache/hub/models--Qwen--Qwen2.5-1.5B-Instruct-GGUF/snapshots/91cad51170dc346986eccefdc2dd33a9da36ead9/qwen2.5-1.5b-instruct-q6_k.gguf' is not a valid JSON file.
  | [2025-08-02T17:58:21Z] FAILED models/quantization/test_gguf.py::test_models[1-5-32-half-model1] - OSError: It looks like the config file at '/fsx/hf_cache/hub/models--bartowski--Phi-3.5-mini-instruct-GGUF/snapshots/6d70da17e749a471ccb62ade694486011a75cda3/Phi-3.5-mini-instruct-IQ4_XS.gguf' is not a valid JSON file.
  | [2025-08-02T17:58:21Z] FAILED models/quantization/test_gguf.py::test_models[1-5-32-half-model2] - OSError: It looks like the config file at '/fsx/hf_cache/hub/models--QuantFactory--gpt2-large-GGUF/snapshots/16ed8338c8e0d67ad6d47f776b2de9bf28338d27/gpt2-large.Q4_K_M.gguf' is not a valid JSON file.
  | [2025-08-02T17:58:21Z] FAILED models/quantization/test_gguf.py::test_models[1-5-32-half-model3] - OSError: It looks like the config file at '/fsx/hf_cache/hub/models--afrideva--stablelm-3b-4e1t-GGUF/snapshots/b98fb0ffeac9463a05bf97a1da5104526658c2eb/stablelm-3b-4e1t.q4_k_m.gguf' is not a valid JSON file.
  | [2025-08-02T17:58:21Z] FAILED models/quantization/test_gguf.py::test_models[1-5-32-half-model4] - OSError: It looks like the config file at '/fsx/hf_cache/hub/models--tsunemoto--TinyDolphin-2.8-1.1b-GGUF/snapshots/72508a28828642d3a49442d2b00a51089d8ec854/tinydolphin-2.8-1.1b.Q6_K.gguf' is not a valid JSON file.

📝 History of failing test

Latest passed commit: 0f81b31
CI started failing at a59cd9d

I suspect CI has been broken earlier than a59cd9d since it doesn't touch GGUF related stuff.

CC List.

No response