You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Use Q4_K for attn_v for Q2_K_S when n_gqa >= 4#4996
Merged
ggerganov merged 1 commit intomasterggerganov/llama.cpp:masterfrom ik/better_q2_k_sggerganov/llama.cpp:ik/better_q2_k_sCopy head branch name to clipboardJan 17, 2024
