ChatON:chat template for OpenChat in meta.json initial go
The first model seen, based on templates added till now into meta json file, that needs a Global Begin. From tokenizer_config json file, it appears like even system role should have a appropriate prefix, unlike what is seen in hardcoded default chat apply template of llama.cpp and chat jinja template.
This commit is contained in:
parent
93115a9733
commit
0f8f2a18c2
1 changed files with 29 additions and 0 deletions
|
@ -349,6 +349,35 @@
|
||||||
"systemuser-system-has-end": true,
|
"systemuser-system-has-end": true,
|
||||||
"systemuser-1st-user-has-begin": false,
|
"systemuser-1st-user-has-begin": false,
|
||||||
"systemuser-1st-user-has-prefix": false
|
"systemuser-1st-user-has-prefix": false
|
||||||
|
},
|
||||||
|
"openchat": {
|
||||||
|
"global": {
|
||||||
|
"begin": "<s>",
|
||||||
|
"end": ""
|
||||||
|
},
|
||||||
|
"system": {
|
||||||
|
"begin": "",
|
||||||
|
"prefix": "GPT4 Correct System: ",
|
||||||
|
"suffix": "<|end_of_turn|>",
|
||||||
|
"end": ""
|
||||||
|
},
|
||||||
|
"user": {
|
||||||
|
"begin": "",
|
||||||
|
"prefix": "GPT4 Correct User: ",
|
||||||
|
"suffix": "<|end_of_turn|>",
|
||||||
|
"end": ""
|
||||||
|
},
|
||||||
|
"assistant": {
|
||||||
|
"begin": "",
|
||||||
|
"prefix": "GPT4 Correct Assistant: ",
|
||||||
|
"suffix": "<|end_of_turn|>",
|
||||||
|
"end": ""
|
||||||
|
},
|
||||||
|
"reverse-prompt": "<|end_of_turn|>",
|
||||||
|
"systemuser-system-has-suffix": true,
|
||||||
|
"systemuser-system-has-end": true,
|
||||||
|
"systemuser-1st-user-has-begin": true,
|
||||||
|
"systemuser-1st-user-has-prefix": true
|
||||||
}
|
}
|
||||||
|
|
||||||
}
|
}
|
||||||
|
|
Loading…
Add table
Add a link
Reference in a new issue