From c1f66f05f53aa42a75b6be7cb8c86b54e585a04f Mon Sep 17 00:00:00 2001 From: Pierrick HYMBERT Date: Sat, 2 Mar 2024 20:19:21 +0100 Subject: [PATCH] server: tests: self-extend add llama-2-7B and Mixtral-8x7B-v0.1 --- examples/server/tests/features/passkey.feature | 7 +++++-- 1 file changed, 5 insertions(+), 2 deletions(-) diff --git a/examples/server/tests/features/passkey.feature b/examples/server/tests/features/passkey.feature index f93b47d49..3fc65fc4d 100644 --- a/examples/server/tests/features/passkey.feature +++ b/examples/server/tests/features/passkey.feature @@ -46,5 +46,8 @@ Feature: Passkey / Self-extend with context shift Then tokens are predicted matching Examples: - | hf_repo | hf_file | n_ctx_train | ngl | n_ctx | n_batch | n_ga | n_ga_w | n_junk | i_pos | passkey | n_predicted | re_content | - | TheBloke/phi-2-GGUF | phi-2.Q4_K_M.gguf | 2048 | 5 | 16384 | 512 | 16 | 512 | 250 | 50 | 42 | 1 | 42 | + | hf_repo | hf_file | n_ctx_train | ngl | n_ctx | n_batch | n_ga | n_ga_w | n_junk | i_pos | passkey | n_predicted | re_content | + | TheBloke/phi-2-GGUF | phi-2.Q4_K_M.gguf | 2048 | 5 | 8192 | 512 | 16 | 512 | 250 | 50 | 42 | 1 | 42 | + | TheBloke/Llama-2-7B-GGUF | llama-2-7b.Q2_K.gguf | 4096 | 3 | 16384 | 512 | 4 | 512 | 500 | 300 | 1234 | 5 | 1234 | + | TheBloke/Mixtral-8x7B-v0.1-GGUF | mixtral-8x7b-v0.1.Q2_K.gguf | 4096 | 2 | 16384 | 512 | 4 | 512 | 500 | 100 | 0987 | 5 | 0987 | +