HuggingFaceH4/starchat-alpha CPP LLM

[ekolawole]

What we need is a local cpp for llm "HuggingFaceH4/starchat-alpha A". It is much better than any other open source chat models at coding. And it does very well at chatting too. This is better than Vicuna.

[chat-guy]

This would be great. It is indeed significantly better than Vicuna as far as code-generation is concerned.

[s-kostyaev]

Looks like we need to integrate https://github.com/ggerganov/ggml/tree/master/examples/starcoder into llama.cpp

[github-actions]

This issue was closed because it has been inactive for 14 days since being marked as stale.