vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

update docs [no ci]

Browse source
This commit is contained in:
Xuan Son Nguyen 2024-12-18 14:32:32 +01:00
parent ecadd37c63
commit 75fe7751e5
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
examples/server/README.md
View file

@ -504,8 +504,8 @@ These words will not be included in the completion, so make sure to add them to
- `tokens`: Same as `content` but represented as raw token ids. Only populated if `"return_tokens": true` or `"stream": true` in the request. - `tokens`: Same as `content` but represented as raw token ids. Only populated if `"return_tokens": true` or `"stream": true` in the request.
- `stop`: Boolean for use with `stream` to check whether the generation has stopped (Note: This is not related to stopping words array `stop` from input options) - `stop`: Boolean for use with `stream` to check whether the generation has stopped (Note: This is not related to stopping words array `stop` from input options)
- `generation_settings`: The provided options above excluding `prompt` but including `n_ctx`, `model`. These options may differ from the original ones in some way (e.g. bad values filtered out, strings converted to tokens, etc.). - `generation_settings`: The provided options above excluding `prompt` but including `n_ctx`, `model`. These options may differ from the original ones in some way (e.g. bad values filtered out, strings converted to tokens, etc.).
- `model`: The path to the model loaded with `-m` - `model`: The model alias (for model path, please use `/props` endpoint)
- `prompt`: The provided `prompt` - `prompt`: The processed `prompt` (special tokens may be added)
- `stop_type`: Indicating whether the completion has stopped. Possible values are: - `stop_type`: Indicating whether the completion has stopped. Possible values are:
- `none`: Generating (not stopped) - `none`: Generating (not stopped)
- `eos`: Stopped because it encountered the EOS token - `eos`: Stopped because it encountered the EOS token