A chat UI for chatting with LLMs, written in Rust. This uses the free 🤗 Hugging Face text generation inference API. The UI was built with Leptos and Bootstrap.
A demo is available here
You'll need Rust and Trunk. Then just run
trunk build --release
to build everything. You'll find the files that need to be served in the dist/
directory.
Or run
trunk serve
to start a local webserver hosting the page.