Introduce C-style API (#370)

Browse source

* Major refactoring - introduce C-style API

* Clean up

* Add <cassert>

* Add <iterator>

* Add <algorithm> ....

* Fix timing reporting and accumulation

* Measure eval time only for single-token calls

* Change llama_tokenize return meaning

...

This commit is contained in:

Georgi Gerganov 2023-03-22 07:32:36 +02:00 • committed by GitHub

parent da0e9fe90c

commit f5a77a629b

No known key found for this signature in database

GPG key ID: 4AEE18F83AFDEB23

14 changed files with 1954 additions and 1752 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

914

main.cpp

View file

File diff suppressed because it is too large Load diff