Skip to content

Commit

Permalink
Merge pull request #806 from SerialKicked/master
Browse files Browse the repository at this point in the history
Fixes Typo in IContextParamsExtensions
  • Loading branch information
martindevans authored Jun 28, 2024
2 parents c1302ef + 59fbb62 commit 1758365
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion LLama/Extensions/IContextParamsExtensions.cs
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ public static void ToLlamaContextParams(this IContextParams @params, out LLamaCo
result.abort_callback_user_data = IntPtr.Zero;

result.type_k = @params.TypeK ?? GGMLType.GGML_TYPE_F16;
result.type_k = @params.TypeV ?? GGMLType.GGML_TYPE_F16;
result.type_v = @params.TypeV ?? GGMLType.GGML_TYPE_F16;
result.offload_kqv = !@params.NoKqvOffload;
result.flash_attention = @params.FlashAttention;
result.llama_pooling_type = @params.PoolingType;
Expand Down

0 comments on commit 1758365

Please sign in to comment.