Skip to content

Commit 7323304

Browse files
committed
Add llmaz as another platform to run llama.cpp on Kubernetes
Signed-off-by: kerthcet <[email protected]>
1 parent cfac111 commit 7323304

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

README.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -191,6 +191,7 @@ Unless otherwise noted these projects are open-source with permissive licensing:
191191

192192
**Infrastructure:**
193193

194+
- [llmaz](https://github.com/InftyAI/llmaz) - ☸️ Effortlessly serve state-of-the-art LLMs on Kubernetes, see [llama.cpp example](https://github.com/InftyAI/llmaz/tree/main/docs/examples/llamacpp) here.
194195
- [Paddler](https://github.com/distantmagic/paddler) - Stateful load balancer custom-tailored for llama.cpp
195196
- [GPUStack](https://github.com/gpustack/gpustack) - Manage GPU clusters for running LLMs
196197

0 commit comments

Comments
 (0)