vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
2914 commits 380 branches 3056 tags 365 MiB
Commit graph

2914 commits

This branch
This branch
All branches
Author SHA1 Message Date
HanishKVC
bf111a83f1 SimpCfg:TemplatedDumbTrim; Test dumb and oversmart trim logics 2024-05-06 11:27:56 +05:30
HanishKVC
554b00f027 SimpCfg: Add some missing const refs 2024-05-06 11:27:56 +05:30
HanishKVC
cae0fff715 SimpCfg: Update notes; Try add a better trimming logic 2024-05-06 11:27:56 +05:30
HanishKVC
d1156cc055 SimpCfg: As locale manipulation reqd for better processing 2024-05-06 11:27:56 +05:30
HanishKVC
2325764180 SimpCfg:CheckStrings: Switch Mbs2Wcs to multithread safe calls 2024-05-06 11:27:56 +05:30
HanishKVC
23acf07bb2 SimpCfg:CheckStrings: Cleanup wstring flow to needed parts 2024-05-06 11:27:56 +05:30
HanishKVC
2cda78f1ad SimpCfg:CheckStrings: WString2String finally 
The constructor method doesnt convert wstring to string, when it
involves non-english chars which will encode to multibyte chars
in utf8. even thou it does work for the already utf8 u8string.

wcstombs doesnt seem to work for non english chars, when the
locale is set to the default c, need to change to something like
en_US.UTF-8, to allow it to do the conversion properly.
 2024-05-06 11:27:56 +05:30
HanishKVC
7607dbc8c7 SimpCfg:CheckStrings: Try fixup wstring handling 2024-05-06 11:27:56 +05:30
HanishKVC
1a618a42f8 SimpCfg: Update the func notes with alert 2024-05-06 11:27:56 +05:30
HanishKVC
66d6fa62b7 SimpCfg: C++ and strings is a mess even after decades 
Seperate out the checks wrt different string types.

Add a wstring_basic, which verifies that wstring iterator handles
non english chars propery or atleast better.
 2024-05-06 11:27:56 +05:30
HanishKVC
3ad5cec47e SimpCfg:CheckStrings:MacOS, wstring and wcout 
Without using imbue, I couldnt get non-english wstrings to print
on mac. Need to check on linux also.

Also avoid the uint8_t typecasting, given that wchar isnt 8bit
 2024-05-06 11:27:56 +05:30
HanishKVC
a448fec486 SimpCfg:CheckString: organise and probe - p3 wstring 
wcouts' involving 2nd wstring with non english char in it not
showing up?
 2024-05-06 11:27:56 +05:30
HanishKVC
691d0d43b5 SimpCfg:CheckStrings: Organise and Probe - P2 - std::u8string 2024-05-06 11:27:56 +05:30
HanishKVC
713520caac SimpCfg:CheckStrings: Organise and Probe - p1 std::string 2024-05-06 11:27:56 +05:30
HanishKVC
56f19c7a68 SimpCfg: Test c++ string handling 2024-05-06 11:27:56 +05:30
HanishKVC
86e776c857 SimpCfg: Rename to get_vector, add some test code 2024-05-06 11:27:56 +05:30
HanishKVC
1e1f54ec1d SimpCfg:GetArray flesh out, helpers to convert to string 
Good: Forgotten love, All the light we cant see, laapataa ladies
 2024-05-06 11:27:56 +05:30
HanishKVC
561f50930e SimpCfg: initial go at adding support for spreadout arrays 
By having a seperate entry for each element of the array, the
existing logic itself can be repurposed with minimal additions.
 2024-05-06 11:27:56 +05:30
HanishKVC
8fdc80533f SimpCfg:Cleanup:Cmdline Arg, GetValueCallerLogging, StringCmp 
Bring the direct string comparison also back, as the issue with
cmp was more to do with string.transform.
 2024-05-06 11:27:56 +05:30
HanishKVC
08b9711d68 SimpCfg:Remove dbug logs wrt str_tolower and set_bool 
Also the warning wrt is it string, now also logs the line number,
group and key, to help user identify the line better.

Misc: pass time last week Another life, Anchakkallakokkan, Deadloch
 2024-05-06 11:27:56 +05:30
HanishKVC
0e0d7da18f SimpCfg:Found issue with str_tolower, transform doesnt resize dst 2024-05-06 11:27:56 +05:30
HanishKVC
eb56517f20 SimpCfg:Bools:Make lowercase b4 checking true/false for bool path 
TODO: string check wrt true/false, doesnt seem to be working after
str_tolower was introduced. I seem to be doing some silly mistake
not able to make out, moving in and out of sleep, need to check
tomorrow.

string == string-literal failed
string == string-view failed
string.compare(string-literal) failed

Bit strange
 2024-05-06 11:27:56 +05:30
HanishKVC
ef5a2cf391 SimpCfg:Dbug why bool is not setting properly 2024-05-06 11:27:56 +05:30
HanishKVC
5aa1072aac SimpCfg: Move dump into its own func, Avoid KV iter wrt Get 2024-05-06 11:27:56 +05:30
HanishKVC
6b475e444f SimpCfg: Log Caller of Set/GetValue 2024-05-06 11:27:56 +05:30
HanishKVC
f05f71bdc4 SimpCfg:SetBool string value, str_tolower, SetValueTypeLogging 2024-05-06 11:27:56 +05:30
HanishKVC
1dc7fd0e85 SimpCfg:WIP:Variant TypeDef, to_str and std::get 
Cleanup the use of the variant

Initialize and << op stringstream seperately.
 2024-05-06 11:27:56 +05:30
HanishKVC
ee1a62c876 SimpCfg:WIP:Switch to C++ Variant type - initial skeleton 2024-05-06 11:27:56 +05:30
HanishKVC
7302b3ab36 SimpCfg: Use stderr wrt internal Log messaging helpers 2024-05-06 11:27:56 +05:30
HanishKVC
a09571318a ChatON: meta-dump returns flag inturn returned by meta-ok 
test-chat-template-chaton now tries to check if meta-ok is ok wrt
the template-id being looked into.

Log template-id info also, where it was previously missed out.
 2024-05-06 11:27:56 +05:30
HanishKVC
a108000cfd ChatON:Phi3: Add template details to detailed meta.json 2024-05-06 11:27:56 +05:30
HanishKVC
44c05305d0 SimpCfg: Add support for get_double 2024-05-06 11:27:56 +05:30
HanishKVC
8ad2c17e5d SimpCfg: get_int64 logic 2024-05-06 11:27:56 +05:30
HanishKVC
000245b8e8 SimpCfg:Warn possible nonstring strings, some invalid floats 
Warn if something not starting with double quote is being treated
as a string.

Show some examples of invalid floating point values wrt this
logics floating point determination code
 2024-05-06 11:27:56 +05:30
HanishKVC
a6648b02f2 SimpCfg:Show floating point values in normal and exponential form 2024-05-06 11:27:56 +05:30
HanishKVC
4181164217 SimpCfg:Implement set_int64 and set_double 
Also update the sample simpcfg file, to test for int and float
values.
 2024-05-06 11:27:56 +05:30
HanishKVC
fb9a7dc7fe SimpCfg:Initial skeleton towards supporting int and floating point 2024-05-06 11:27:56 +05:30
HanishKVC
d0b3ebf32e SimpCfg: Use & wrt destination of [] operation 
so that one can update the value-item's content, without needing
to explicitly update/store the value-item back into map after the
content has been updated.

This should make these setting operations/helpers more efficient.
 2024-05-06 11:27:56 +05:30
HanishKVC
0a534e6897 SimpCfg: Rename test program related #define 2024-05-06 11:27:56 +05:30
HanishKVC
ca5a04d607 SimpCfg: Remove double quotes around group, key or string value 2024-05-06 11:27:56 +05:30
HanishKVC
82348e2840 SimpCfg: Put GroupMap back into Map, Iterate during get if DBUG 
TODO: Have to look into C++ a bit later including these default
container types. Not sure my current flow is efficient.
 2024-05-06 11:27:56 +05:30
HanishKVC
9940bd8ed7 SimpCfg: Allow default values wrt set string and set bool 2024-05-06 11:27:56 +05:30
HanishKVC
951fbc3396 SimpCfg: Change logging to LDBUG and LERRR helpers 2024-05-06 11:27:56 +05:30
HanishKVC
d514c81829 SimpCfg: Add the const which I had forgotten wrt args 2024-05-06 11:27:56 +05:30
HanishKVC
6de8a14f32 SimpCfg: Rename member functions to avoid sc_ prefix 
now that logic has been converted into a class, no need for this
prefix
 2024-05-06 11:27:56 +05:30
HanishKVC
1ecca5a7ec SimpCfg: Convert to a class 2024-05-06 11:27:56 +05:30
HanishKVC
28ae0c5b02 SimpCfg:Make str_trim flexible, use to trim , wrt value 
Now one can pass the list/string of chars to trim at either end.
 2024-05-06 11:27:56 +05:30
HanishKVC
2cbb00c340 SimpCfg: Add support for boolean fields wrt key-value 2024-05-06 11:27:56 +05:30
HanishKVC
f728dbddd0 ChatON: Add simpcfg based config file matching chaton_meta.json 
Add missing begin and end fields wrt deepseek-coder assistant in
chaton_meta.json.

Idea is to avoid json library dependency by adding a simple text
based config file support.
 2024-05-06 11:27:56 +05:30
HanishKVC
aea6850131 SimpCfg: Keep compiler happy, also add newline wrt alt logging def 2024-05-06 11:27:56 +05:30