From cf4c86ee20873645fd2d3506cf168d12ca971838 Mon Sep 17 00:00:00 2001 From: Pierrick HYMBERT Date: Sat, 2 Mar 2024 14:31:27 +0100 Subject: [PATCH] server: tests - passkey - first good working value of nga --- examples/server/tests/features/passkey.feature | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/examples/server/tests/features/passkey.feature b/examples/server/tests/features/passkey.feature index 72f8bce0b..a8e8acb3d 100644 --- a/examples/server/tests/features/passkey.feature +++ b/examples/server/tests/features/passkey.feature @@ -16,6 +16,7 @@ Feature: Passkey / Self-extend with context shift Given a model file from HF repo And as batch size And as number of junk + And server max tokens to predict And a self-extend context with a factor of And as seed And a KV cache size based on the model trained context extended by with additional tokens @@ -50,4 +51,4 @@ Feature: Passkey / Self-extend with context shift Examples: | hf_repo | hf_file | n_ctx_train | ngl | n_batch | n_slots | n_ga | n_ga_w | n_junk | n_grp | i_pos | seed | n_keep | passkey | n_predicted | re_content | - | TheBloke/phi-2-GGUF | phi-2.Q4_K_M.gguf | 2048 | 5 | 512 | 1 | 4 | 2048 | 250 | 4 | 50 | 86 | 32 | 42 | -1 | .*42.* | + | TheBloke/phi-2-GGUF | phi-2.Q4_K_M.gguf | 2048 | 5 | 512 | 1 | 8 | 512 | 250 | 4 | 50 | 86 | 32 | 42 | -1 | .*42.* |