Georgi Gerganov
|
e972e6cbf8
|
unicode : clean-up
|
2024-04-28 18:30:37 +03:00 |
|
Georgi Gerganov
|
b97add52a4
|
unicode : category support via std::regex
|
2024-04-28 15:15:57 +03:00 |
|
Georgi Gerganov
|
06d3e693db
|
unicode : fix? unicode_wstring_to_utf8
|
2024-04-26 12:55:11 +03:00 |
|
Kazim Abrar Mahi
|
feeaf4f39c
|
Added needed functionality, testing remains
|
2024-04-26 11:43:29 +03:00 |
|
Kazim Abrar Mahi
|
7e308ed212
|
Adding unicode regex function
|
2024-04-26 11:43:29 +03:00 |
|
Kazim Abrar Mahi
|
a5710a4101
|
Adding unicode regex mappings
|
2024-04-26 11:43:29 +03:00 |
|
Jared Van Bortel
|
32c8486e1f
|
wpm : portable unicode tolower (#6305)
Also use C locale for ispunct/isspace, and split unicode-data.cpp from unicode.cpp.
|
2024-03-26 17:46:21 -04:00 |
|