fixed a bug with token timings, updated lite

2023-06-20 20:41:42 +08:00 · 2023-06-20 20:41:42 +08:00 · 537ff22ec9
commit 537ff22ec9
parent c5ae3f50a7
2 changed files with 4 additions and 3 deletions
--- a/gpttype_adapter.cpp
+++ b/gpttype_adapter.cpp
@ -1265,6 +1265,7 @@ generation_outputs gpttype_generate(const generation_inputs inputs, generation_o

            if(unbanTokens && id==eosID)
            {
+                stopper_unused_tokens = remaining_tokens;
                printf("\n(EOS token triggered!)");
                remaining_tokens = 0;
            }
--- a/klite.embd
+++ b/klite.embd