From 514fb761051a48de73fc99d8f59d9060dfaee189 Mon Sep 17 00:00:00 2001 From: thxCode Date: Mon, 5 Aug 2024 21:09:15 +0800 Subject: [PATCH] readme: introduce gpustack GPUStack is an open-source GPU cluster manager for running large language models, which uses llama.cpp as the backend. Signed-off-by: thxCode --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 1283f6805..8a26d84e5 100644 --- a/README.md +++ b/README.md @@ -190,6 +190,7 @@ Unless otherwise noted these projects are open-source with permissive licensing: **Infrastructure:** - [Paddler](https://github.com/distantmagic/paddler) - Stateful load balancer custom-tailored for llama.cpp +- [GPUStack](https://github.com/gpustack/gpustack) - Manage GPU clusters for running LLMs **Games:** - [Lucy's Labyrinth](https://github.com/MorganRO8/Lucys_Labyrinth) - A simple maze game where agents controlled by an AI model will try to trick you.