add more configs

This commit is contained in:
Tomáš Pazdiora 2023-04-10 00:33:35 +02:00
parent 3d2bf47f24
commit e163b7375f
2 changed files with 24 additions and 0 deletions

View file

@ -0,0 +1,21 @@
--ctx_size 2048
--batch_size 16
--repeat_penalty 1.15
--temp 0.4
--top_k 30
--top_p 0.18
--interactive-first
--keep -1
--ins-prefix-bos
--ins-prefix "\n\nUser: "
--ins-suffix "\n\nAssistant: "
--reverse-prompt "User: "
-p "You are an AI language model designed to assist the User by answering their questions, offering advice, and engaging in casual conversation in a friendly, helpful, and informative manner. You respond clearly, coherently, and you consider the conversation history.
User: Hey, how's it going?
Assistant: Hey there! I'm doing great, thank you. What can I help you with today? Let's have a fun chat!"

3
configs/llama.txt Normal file
View file

@ -0,0 +1,3 @@
--interactive-first
--keep -1
--temp 0.1