vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

ChatON:chat template for OpenChat in meta.json initial go

Browse source 
The first model seen, based on templates added till now into meta
json file, that needs a Global Begin.

From tokenizer_config json file, it appears like even system role
should have a appropriate prefix, unlike what is seen in hardcoded
default chat apply template of llama.cpp and chat jinja template.
This commit is contained in:
HanishKVC 2024-05-05 15:18:24 +05:30
parent 93115a9733
commit 0f8f2a18c2
1 changed files with 29 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

29
examples/chaton_meta.json
View file

@ -349,6 +349,35 @@
"systemuser-system-has-end": true,
"systemuser-1st-user-has-begin": false,
"systemuser-1st-user-has-prefix": false
},
"openchat": {
"global": {
"begin": "<s>",
"end": ""
},
"system": {
"begin": "",
"prefix": "GPT4 Correct System: ",
"suffix": "<|end_of_turn|>",
"end": ""
},
"user": {
"begin": "",
"prefix": "GPT4 Correct User: ",
"suffix": "<|end_of_turn|>",
"end": ""
},
"assistant": {
"begin": "",
"prefix": "GPT4 Correct Assistant: ",
"suffix": "<|end_of_turn|>",
"end": ""
},
"reverse-prompt": "<|end_of_turn|>",
"systemuser-system-has-suffix": true,
"systemuser-system-has-end": true,
"systemuser-1st-user-has-begin": true,
"systemuser-1st-user-has-prefix": true
}
}