This commit is contained in:
Sameer Charles 2024-06-01 08:00:21 +10:00 committed by GitHub
commit b18295249e
No known key found for this signature in database
GPG key ID: B5690EEEBB952194

View file

@ -150,6 +150,8 @@ Typically finetunes of the base models below are supported as well.
[llama.cpp web server](./examples/server) is a lightweight [OpenAI API](https://github.com/openai/openai-openapi) compatible HTTP server that can be used to serve local models and easily connect them to existing clients.
- [Inferenceable](https://github.com/HyperMink/inferenceable)
**Bindings:**
- Python: [abetlen/llama-cpp-python](https://github.com/abetlen/llama-cpp-python)