ChatON: Add a note
This commit is contained in:
parent
e23b5c8689
commit
9037892127
1 changed files with 16 additions and 0 deletions
|
@ -1,5 +1,21 @@
|
|||
#pragma once
|
||||
|
||||
/**
|
||||
*
|
||||
* Provides a simple and dumb helpers which help chat with llm chat/instruct models
|
||||
* using the chat template expected by them.
|
||||
*
|
||||
* Normally used to tag system prompt and user messages.
|
||||
* Currently used by example/main programs.
|
||||
*
|
||||
* This builds on the llama_chat_apply_template. When adding support for new chat templates
|
||||
* remember to update llama_chat_apply_template_internal as well as llama_chat_reverse_prompt.
|
||||
*
|
||||
* example/main program uses this when --chaton TEMPLATE_ID is passed to it along with -i
|
||||
* sample TEMPLATE_ID's include chatml, llama2, llama3, ...
|
||||
*
|
||||
*/
|
||||
|
||||
#include <vector>
|
||||
#include <string>
|
||||
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue