ChatON:Initial go at vicuna chat template in meta.json
Have looked at tokenizer_config.json, jinja file and default hardcoded template in llama.cpp. This is also one of the models where a Global BoS is needed. NOTE: Have taken the liberty to also add a SYSTEM: prefix wrt system message, even thou default vicuna doesnt seem to need, but vicuna-orca seems to need, so that both models can be driven from same chat template config. I am assuming the system prefix should not create any problem even in default vicuna, however if it does create a problem one can duplicate the existing vicuna block in chaton_meta.json and make the system prefix empty in it.
This commit is contained in:
parent
0f8f2a18c2
commit
b875b02979
1 changed files with 29 additions and 0 deletions
|
@ -378,6 +378,35 @@
|
|||
"systemuser-system-has-end": true,
|
||||
"systemuser-1st-user-has-begin": true,
|
||||
"systemuser-1st-user-has-prefix": true
|
||||
},
|
||||
"vicuna": {
|
||||
"global": {
|
||||
"begin": "<s>",
|
||||
"end": ""
|
||||
},
|
||||
"system": {
|
||||
"begin": "",
|
||||
"prefix": "SYSTEM: ",
|
||||
"suffix": "\n\n",
|
||||
"end": ""
|
||||
},
|
||||
"user": {
|
||||
"begin": "",
|
||||
"prefix": "USER: ",
|
||||
"suffix": "\n",
|
||||
"end": ""
|
||||
},
|
||||
"assistant": {
|
||||
"begin": "",
|
||||
"prefix": "ASSISTANT: ",
|
||||
"suffix": "</s>\n",
|
||||
"end": ""
|
||||
},
|
||||
"reverse-prompt": "</s>",
|
||||
"systemuser-system-has-suffix": true,
|
||||
"systemuser-system-has-end": true,
|
||||
"systemuser-1st-user-has-begin": true,
|
||||
"systemuser-1st-user-has-prefix": true
|
||||
}
|
||||
|
||||
}
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue