2 commits

Author	SHA1	Message	Date
Georgi Gerganov	120cf37d54	models : add phi-3, mpt, gpt-2, starcoder	2024-04-29 13:40:30 +03:00
Galunid	daab3d7f45	Add more tokenizer tests (#3742) ... * Add more tokenizer tests * Add starcoder * Update test vocab files * Restrict bpe tokenizer tests to unicode planes * Update comment * Comment cosmetics * Remove bloom vocab/test	2023-10-24 09:17:17 +02:00