convert : fix pre-tokenizer type writing

This commit is contained in:
Georgi Gerganov 2024-04-26 20:55:14 +03:00
parent 43e12ce8e5
commit 1b9b79dd14
No known key found for this signature in database
GPG key ID: 449E073F9DC10735
4 changed files with 3 additions and 1 deletions