Exception when trying to create LlamaCpp wrapper for deepseek coder 1.3b

[Columpio]

The bug
I get an exception:

terminate called after throwing an instance of 'std::out_of_range'
  what():  _Map_base::at

when trying to create a LlamaCpp wrapper for deepseek coder 1.3b

I tried to debug and it seems that this line fails when i == 32015.
Can't tell whether it is a guidance or llama.cpp issue.

To Reproduce

lm = models.LlamaCpp(model="/home/ggufs/deepseek-coder-1.3b-instruct.Q5_K_M.gguf") # you can download the exact model from the link above

System info:
OS: Windows 11, under wsl

WSL version: 2.1.5.0
Kernel version: 5.15.146.1-2
WSLg version: 1.0.60
MSRDC version: 1.2.5105
Direct3D version: 1.611.1-81528511
DXCore version: 10.0.25131.1002-220531-1700.rs-onecore-base2-hyp
Windows version: 10.0.22631.3296

 $ uname -a
Linux columpio 5.15.146.1-microsoft-standard-WSL2 #1 SMP Thu Jan 11 04:09:03 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux

>>> print(guidance.__version__)
0.1.13

[Columpio]

It now works just fine with

• guidance==0.1.14
• llama_cpp_python==0.2.74
• https://huggingface.co/RichardErkhov/deepseek-ai_-_deepseek-coder-1.3b-instruct-gguf/resolve/main/deepseek-coder-1.3b-instruct.Q5_K_M.gguf

So I close the issue.