You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
While i was looking around the code trying to figure a few issues compared to base LLama.cpp (memory consumption and repetition penalty doing weird things), I found this:
Description
While i was looking around the code trying to figure a few issues compared to base LLama.cpp (memory consumption and repetition penalty doing weird things), I found this:
LLamaSharp/LLama/Extensions/IContextParamsExtensions.cs
Lines 50 to 51 in c1302ef
param.TypeV and param.TypeK are both assigned to result.type_k
I'm not exactly an expert in LLama.cpp / GGUF architecture, but it seems there's a mix-up.
Reproduction Steps
N/A
Environment & Configuration
Known Workarounds
No response
The text was updated successfully, but these errors were encountered: