diff --git a/examples/server/README.md b/examples/server/README.md index 82f9a373f..db3c7f6ff 100644 --- a/examples/server/README.md +++ b/examples/server/README.md @@ -529,6 +529,16 @@ If `with_pieces` is `true`: } ``` +With input 'รก' (utf8 hex: C3 A1) on tinyllama/stories260k +```json +{ + "tokens": [ + {"id": 198, "piece": [195]}, // hex C3 + {"id": 164, "piece": [161]} // hex A1 + ] +} +``` + ### POST `/detokenize`: Convert tokens to text *Options:*