How to make a simple UI change in Llama-Server?

[simusid]

I am not a front end developer but I want to make a trivial change to the top of the main page with a MOTD message to my users. Between the old and new UI, regular index.html, typescript, and index.html.gz, I'm genuinely confused as to where this needs to go and how to build it. In short, where would I put

Here's an important message!

[ngxson]

The old single-html file structure is not scalable. In order to have cool features like conversions, file upload, etc, we moved to a proper modern frontend stack, which now requires certain knowledge about modern frontend development.

Tbh, I don't think this is a beginner-friendly space, as frontend development is hard to get right. Nowadays, we usually only accept PRs if the code follows correct reactjs / typescript practices.

[ruicatxiao]

It would be great if there is ANY write up to changing simple elements such as UI title from the default "llama.cpp" message

[ruicatxiao]

Did you ever figure this out OP?

[ruicatxiao]

I tried modifying Header.tsx in the lama.cpp/tools/server/webui/src/components folder. Specifically I changed the line

llama.cpp

I Enabled -DLLAMA_BUILD_SERVER=ON. However after compiling it still does not show custom header message in llama.server. I am out of ideas now

[am17an]

I can maybe help since I just made a small change. Firstly, if you want to develop fast you should do cd webui && npm run dev (make sure npm is installed). This will launch an application at localhost:5173 using vite

After you are satisfied with your change it's time to build, you can follow these steps

1. npm run build in tools/server/webui, this will create the index.html.gz

2. rebuild llama-server from the root, this should include the compressed index.html.gz as a header
   You should see something like this while it's building
   [ 92%] Generating index.html.gz.hpp

3. Your change should be visible on the 8080 port now

[ruicatxiao]

Maybe a stupid question. How do you rebuild just llama-server?

[ruicatxiao]

Nvm the server I operate on cannot even get npm install to complete since it is behind firewall.

What about manually editing index.html.gz and then rebuild the server? Would that work? After all I just need to change out the title

[am17an]

Yes you can try. Unzip the file and change the <title>, gzip it back again and rebuild the server