vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

SimpleChat: readme stream-utf-8 trim-english deps, exception2error

Browse source
This commit is contained in:
HanishKVC 2024-05-30 00:39:58 +05:30
parent 0e7880a694
commit 48f02e0b5c
2 changed files with 6 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

5
examples/server/public_simplechat/readme.md
View file

@ -133,6 +133,8 @@ It is attached to the document object. Some of these can also be updated using t
bStream - control between oneshot-at-end and live-stream-as-its-generated collating and showing bStream - control between oneshot-at-end and live-stream-as-its-generated collating and showing
of the generated response. of the generated response.
the logic assumes that the text sent from the server follows utf-8 encoding.
apiEP - select between /completions and /chat/completions endpoint provided by the server/ai-model. apiEP - select between /completions and /chat/completions endpoint provided by the server/ai-model.
bCompletionFreshChatAlways - whether Completion mode collates complete/sliding-window history when bCompletionFreshChatAlways - whether Completion mode collates complete/sliding-window history when
@ -151,6 +153,9 @@ It is attached to the document object. Some of these can also be updated using t
continue starting from the trimmed part, thus allows long response to be recovered/continued continue starting from the trimmed part, thus allows long response to be recovered/continued
indirectly, in many cases. indirectly, in many cases.
The histogram/freq based trimming logic is currently tuned for english language wrt its
is-it-a-alpabetic|numeral-char regex match logic.
chatRequestOptions - maintains the list of options/fields to send along with chat request, chatRequestOptions - maintains the list of options/fields to send along with chat request,
irrespective of whether /chat/completions or /completions endpoint. irrespective of whether /chat/completions or /completions endpoint.

2
examples/server/public_simplechat/simplechat.js
View file

@ -502,7 +502,7 @@ class MultiChatUI {
} }
this.handle_user_submit(this.curChatId, gMe.apiEP).catch((/** @type{Error} */reason)=>{ this.handle_user_submit(this.curChatId, gMe.apiEP).catch((/** @type{Error} */reason)=>{
let msg = `ERRR:SimpleChat\nMCUI:HandleUserSubmit:${this.curChatId}\n${reason.name}:${reason.message}`; let msg = `ERRR:SimpleChat\nMCUI:HandleUserSubmit:${this.curChatId}\n${reason.name}:${reason.message}`;
console.debug(msg.replace("\n", ":")); console.error(msg.replace("\n", ":"));
alert(msg); alert(msg);
this.ui_reset_userinput(); this.ui_reset_userinput();
}); });