Text Generation Web UI: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, llama.cpp (GGUF), Llama models NOTE: If you are using an older version of the template, the password for Jupyter is Jup1t3R! - there is no password for newer versions of the template.
NOTE: The legacy APIs no longer work with the latest version of the Text Generation Web UI. They were deprecated since November 2023 and have now been completely removed. If you want to use the LEGACY APIs, please set the image tag to 1.9.5. You will also have to add port 6000 for the legacy REST API and/or port 6005 for the legacy Websockets API.
Lagrange RUN URL
https://lagrangedao.org/spaces/0x129ddcdA5B114c05d4932CC553535Ef3cC9201D5/text-Generation/app
