Commit graph

2 commits

Author SHA1 Message Date
Georgi Gerganov
120cf37d54
models : add phi-3, mpt, gpt-2, starcoder 2024-04-29 13:40:30 +03:00
goerch
9e70cc0322
Add test for MPT tokenization (#3728)
* Add test for MPT tokenization

* Revert code motion

* Remove unnecessary restriction in test case

* Clarify logic in conversion
2023-10-22 21:21:42 +02:00