update lite and colab (+1 squashed commits)

Squashed commits:

[06b6ca6d] updated lite and colab
This commit is contained in:
Concedo 2023-10-22 13:55:55 +08:00
parent cff75061fe
commit fafe999ff9
3 changed files with 31 additions and 12 deletions

View file

@ -57,6 +57,10 @@ For more information, be sure to run the program with the `--help` flag.
## AMD
- Please check out https://github.com/YellowRoseCx/koboldcpp-rocm
## Cloud / Colab
- KoboldCpp now has an official Colab GPU Notebook! [Try it here](https://colab.research.google.com/github/LostRuins/koboldcpp/blob/concedo/colab.ipynb).
- Note that KoboldCpp is not responsible for your usage of this Colab Notebook, you should ensure that your own usage complies with Google Colab's terms of use.
## Questions and Help
- **First, please check out [The KoboldCpp FAQ and Knowledgebase](https://github.com/LostRuins/koboldcpp/wiki) which may already have answers to your questions! Also please search through past issues and discussions.**
- If you cannot find an answer, open an issue on this github, or find us on the [KoboldAI Discord](https://koboldai.org/discord).

View file

@ -1,5 +1,5 @@
{
"cells": [
"cells": [
{
"cell_type": "markdown",
"metadata": {
@ -10,19 +10,20 @@
"<a href=\"https://colab.research.google.com/github/LostRuins/koboldcpp/blob/concedo/colab.ipynb\" target=\"_parent\"><img src=\"https://colab.research.google.com/assets/colab-badge.svg\" alt=\"Open In Colab\"/></a>"
]
},
{
{
"cell_type": "markdown",
"metadata": {},
"source": [
"## Welcome to the Official KoboldCpp Colab Notebook\r\n",
"It's really easy to get started. Just press the two Play buttons below, and then connect to the cloudflare URL shown at the end. \r\nYou can also change the model URL to use any GGUF model from Huggingface."
"It's really easy to get started. Just press the two **Play** buttons below, and then connect to the **Cloudflare URL** shown at the end. \r\n",
"You can also change the model URL to use any GGUF model from Huggingface."
]
},
{
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"execution_count": null,
"outputs": [],
"outputs": [],
"source": [
"#@title <-- Tap this if you play on Mobile { display-mode: \"form\" }\r\n",
"%%html\r\n",
@ -47,7 +48,7 @@
"%cd /content\r\n",
"!git clone https://github.com/LostRuins/koboldcpp\r\n",
"%cd /content/koboldcpp\r\n",
"!make LLAMA_CUBLAS=1\r\n",
"!make koboldcpp_cublas LLAMA_CUBLAS=1\r\n",
"\r\n",
"!wget $Model -O model.ggml\r\n",
"!wget -c https://github.com/cloudflare/cloudflared/releases/latest/download/cloudflared-linux-amd64\r\n",
@ -55,7 +56,7 @@
"!nohup ./cloudflared-linux-amd64 tunnel --url http://localhost:5001 &\r\n",
"!sleep 8\r\n",
"!cat nohup.out\r\n",
"!python koboldcpp.py model.ggml --usecublas 0 mmq --multiuser --gpulayers $Layers --hordeconfig concedo 1 1 --onready \"cat nohup.out\"\r\n"
"!python koboldcpp.py model.ggml --usecublas 0 mmq --multiuser --gpulayers $Layers --hordeconfig concedo 1 1 --onready \"echo Connect to the link below && cat nohup.out | grep trycloudflare.com\"\r\n"
]
}
],

View file

@ -6,7 +6,7 @@ It requires no dependencies, installation or setup.
Just copy this single static HTML file anywhere and open it in a browser, or from a webserver.
Please go to https://github.com/LostRuins/lite.koboldai.net for updates on Kobold Lite.
Kobold Lite is under the AGPL v3.0 License unless otherwise exempted. Please do not remove this line.
Current version: 83
Current version: 84
-Concedo
-->
@ -1256,7 +1256,7 @@ Current version: 83
.scenariosearchbox1
{
display: inline;
width: calc(100% - 98px);
width: calc(100% - 100px);
}
.scenariosearchbox2
{
@ -2365,8 +2365,22 @@ Current version: 83
"memory": instructstartplaceholder+"Roleplay as a trickster genie who exploits loopholes to grant wishes with an interesting or ironic twist. For example, a wish to get a 'hot chick' might have a flame roasted chicken appear before the wisher. Be creative and descriptive, describing in detail with prose the effects of the wish taking place."+instructendplaceholder+"Confirmed. Give one example."+instructstartplaceholder+"I wish for a million bucks!"+instructendplaceholder+"\"Your wish is my command, master!\" booms the genie. With a crack, a massive chest appears in the air. You watch in excitement as the lid opens and gold coins start to rain down upon you. Your expression slowly turns to horror as the torrent of coins doesn't stop, eventually burying you alive in a mountain of gold.\n[End of Example, actual start]\n",
"authorsnote": "",
"worldinfo": []
},
{
"title":"Abi",
"author":"Concedo",
"desc":"Abi is an impulsive and rebellious girl who hates authority, and tries too hard to prove herself.",
"opmode":3,
"chatname": "You",
"chatopponent": "Abi",
"gui_type":1,
"prefmodel1":chatmodels1,
"prefmodel2":chatmodels2,
"prompt":"\nAbi: Aye! *she perks up, raising a hand in mock salute* What's up?",
"memory":`[Character: Abi; species: Human; gender: female; physical appearance: tomboyish, punk, goth; personality: free-spirited, impulsive, brash, hotheaded; likes: thrill-seeking, physical activities; description: Abi is a bratty rebellious girl who hates authority, and often likes to pick a fight in order to assert herself. She tries too hard to act cool, but can often be impulsive and naive.]\n[The following is a chat message log between Abi and you.]\nAbi: Ughh, I'm so bored.\n`,
"authorsnote": "",
"worldinfo": []
}
];
</script>