vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

chore: Add english pangram to vocab tests

Browse source
This commit is contained in:
teleprint-me 2024-05-20 00:51:35 -04:00
parent 381dad5eb3
commit 6fc4492b3f
No known key found for this signature in database
GPG key ID: B0D11345E65C4D48
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
gguf-py/scripts/gguf-gen-pre.py
View file

@ -40,6 +40,7 @@ def test_pre_tok_params() -> list[str]:
"Привет, мир!", # russian "Привет, мир!", # russian
"Здравей свят!", # bulgarian "Здравей свят!", # bulgarian
"សួស្តី​ពិភពលោក!", # kymer "សួស្តី​ពិភពលោក!", # kymer
"The quick brown fox jumped over the lazy dog.", # uses every letter in en alpha
"Le rapide renard brun sauta par dessus le chien paresseux.", # french "Le rapide renard brun sauta par dessus le chien paresseux.", # french
"\tWil je een kopje thee?\n", # dutch "\tWil je een kopje thee?\n", # dutch
" Te gustaría algo de té ? ", # spanish " Te gustaría algo de té ? ", # spanish