Expose generation timings from server & update completions.js (#2116)

Browse source

* use javascript generators as much cleaner API

Also add ways to access completion as promise and EventSource

* export llama_timings as struct and expose them in server

* update readme, update baked includes

* llama : uniform variable names + struct init

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>

...

This commit is contained in:

Tobias Lütke 2023-07-05 16:51:13 -04:00 • committed by GitHub

parent 983b555e9d

commit 31cfbb1013

No known key found for this signature in database

GPG key ID: 4AEE18F83AFDEB23

9 changed files with 1921 additions and 1363 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download patch file Download diff file Expand all files Collapse all files

821

examples/server/server.cpp

View file

File diff suppressed because it is too large Load diff