NixOS module request: open-webui (formerly ollama-webui)

[Kreyren]

Project description

WebUI service for Large Language Models

Video demonstration by NetworkChunk: https://youtu.be/Wjrdr0NU4Sk?t=570

.. basically self-hostable ChatGPT-like service

Metadata

• homepage URL: https://openwebui.com
• source URL: https://github.com/open-webui/open-webui
• license: mit
• platforms: unix, linux, darwin

Additional info

Follow-up on #273556 for open-webui nixos module.

There seems to be an ongoing work on the subject by @mschwaig and @malteneuss on master...mschwaig:nixpkgs:open-webui

---

Add a 👍 reaction to issues you find important.

[Kreyren]

Relevant Merge Request: #275448

[mausch]

Just for reference / workaround here's another nix package: https://github.com/shivaraj-bh/ollama-flake/tree/main/pkgs/open-webui

[malteneuss]

@mausch Thanks for that reference. That pdm tool workaround looks a lot more maintainable for the Python backend. Maybe i'll have time to try another PR in the next weeks.
In the meantime and as a much simpler UI i packaged https://github.com/jakobhoeg/nextjs-ollama-llm-ui as part of PR #313146. It would be great if someone could review it.

[shivaraj-bh]

I would like to mention that in the latest release open-webui switched to downloading pyodide dependencies in build time, I am not sure of any straightforward way to do this while packaging it for nixpkgs.

[drupol]

@shivaraj-bh I just tested your flake, it's impressive, especially the nice UI at the end showing all the processes !

Regarding open-webui, it would be so nice to have that in nixpkgs !!!

[shivaraj-bh]

I just tested your flake, it's impressive, especially the nice UI at the end showing all the processes !

Thank you, planning to have more UIs and devShell integration (for CLI tools that interact with ollama).

Regarding open-webui, it would be so nice to have that in nixpkgs

I would love that too! Although there are a few challenges (like the one I pointed above regarding pyotide), I am willing to contribute here.

Also, open-webui maintainers are quick to respond, in case we need any upstream contributions to make it happen.