vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
llama.cpp/examples/batched.swift
History
staviq 1a159553f9
tokenizer : special token handling (#3538) 
* Rewrite special token handling from #1931

* shorten param name, add st verification by type

* use offsets instead of copy by substr

* formatting, remove copying iterator on delete

* llama : normalize code-style

* swift fix

* print pfx/sfx if verb, main: split pfx input sfx

* dont add space when using special tokens

* minor : comment + spacing

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2023-10-17 18:11:01 +03:00
..
Sources tokenizer : special token handling (#3538) 2023-10-17 18:11:01 +03:00
.gitignore examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
Makefile examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
Package.swift examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00
README.md examples : add batched.swift + improve CI for swift (#3562) 2023-10-11 06:14:05 -05:00

README.md

This is a swift clone of examples/batched.

$ make $ ./swift MODEL_PATH [PROMPT] [PARALLEL]