Commit graph

7 commits

Author SHA1 Message Date
Georgi Gerganov
f86b9d152c
lookup : minor 2023-12-17 17:25:28 +02:00
Georgi Gerganov
5b27975479
lookup : fix token positions in the draft batch 2023-12-17 16:47:26 +02:00
Leon Ericsson
1b26d7151a Added colors to distinguish drafted tokens (--color). Updated README 2023-12-17 13:04:46 +01:00
Leon Ericsson
21431197a1 kv_cache management 2023-12-16 12:12:33 +01:00
Leon Ericsson
1665ad8bf1 BUG: generates gibberish/repeating tokens after a while 2023-12-15 14:14:17 +01:00
Leon Ericsson
0ec5fdb5ce main loop finished, starting to debug 2023-12-10 20:20:01 +01:00
Leon Ericsson
cae8f50b1a initial commit, going through initializations 2023-12-04 21:52:17 +01:00