From 60d26ded4be8531761f0f83ae41bae9a75d840e8 Mon Sep 17 00:00:00 2001 From: Georgi Gerganov Date: Fri, 13 Dec 2024 14:04:09 +0200 Subject: [PATCH] readme : restore hint about --ignore-eos flag [no ci] --- examples/main/README.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/examples/main/README.md b/examples/main/README.md index ae3b13b7b..17d80a622 100644 --- a/examples/main/README.md +++ b/examples/main/README.md @@ -163,7 +163,7 @@ If the pause is undesirable, a value of -2 will stop generation immediately when The `--no-context-shift` option allows you to stop the infinite text generation once the finite context window is full. -It is important to note that the generated text may be shorter than the specified number of tokens if an End-of-Sequence (EOS) token or a reverse prompt is encountered. In interactive mode, text generation will pause and control will be returned to the user. In non-interactive mode, the program will end. In both cases, the text generation may stop before reaching the specified `--predict` value. +It is important to note that the generated text may be shorter than the specified number of tokens if an End-of-Sequence (EOS) token or a reverse prompt is encountered. In interactive mode, text generation will pause and control will be returned to the user. In non-interactive mode, the program will end. In both cases, the text generation may stop before reaching the specified `--predict` value. If you want the model to keep going without ever producing End-of-Sequence on its own, you can use the `--ignore-eos` parameter. ### Temperature