Skip to content

Commit 514fb76

Browse files
committed
readme: introduce gpustack
GPUStack is an open-source GPU cluster manager for running large language models, which uses llama.cpp as the backend. Signed-off-by: thxCode <thxcode0824@gmail.com>
1 parent 3a14e00 commit 514fb76

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -190,6 +190,7 @@ Unless otherwise noted these projects are open-source with permissive licensing:
190190
**Infrastructure:**
191191

192192
- [Paddler](https://github.com/distantmagic/paddler) - Stateful load balancer custom-tailored for llama.cpp
193+
- [GPUStack](https://github.com/gpustack/gpustack) - Manage GPU clusters for running LLMs
193194

194195
**Games:**
195196
- [Lucy's Labyrinth](https://github.com/MorganRO8/Lucys_Labyrinth) - A simple maze game where agents controlled by an AI model will try to trick you.

0 commit comments

Comments
 (0)