From ce8fe5d88dbcfbf0a5c3037bd945379a521198c8 Mon Sep 17 00:00:00 2001 From: Pierrick HYMBERT Date: Sat, 17 Feb 2024 15:05:14 +0100 Subject: [PATCH] server: document new status no slot available in the README.md --- examples/server/README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/examples/server/README.md b/examples/server/README.md index 249368749..c3f18630e 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -135,6 +135,7 @@ node index.js - `{"status": "loading model"}` if the model is still being loaded. - `{"status": "error"}` if the model failed to load. - `{"status": "ok"}` if the model is successfully loaded and the server is ready for further requests mentioned below. + - `{"status": "no slot available", "slots_idle": 0, "slots_processing": 32}` if no slot are currently available - **POST** `/completion`: Given a `prompt`, it returns the predicted completion.