Add a webui to this

[suoko]

This repo was the only way I find to successfully run a vicuna model (ggml-vic13b-uncensored-q8_0.bin) but I miss a web ui.
Can you suggest how to add one ?
How can I make text-generation-webui use this llama.cpp ?

[akx]

oobabooga/text-generation-webui already has support for llama.cpp – if you have trouble making it work with this repo, you should probably ask there.

[JohannesGaessler]

I think llama.cpp itself should not have a GUI. Instead it should be packaged as a library that external applications can then in turn use for inference.

[evanmiller]

See the new code in examples/server – web UI included!

[rain-1]

That's great that a Chat UI was added. Please add a Text Continuation UI also.

[rain-1]

Related

• Simple webchat for server #1998
• ADD Chatbot UI example #1424

[Green-Sky]

closing as completed.