vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update README.md

Browse source
This commit is contained in:
LostRuins 2023-03-19 00:21:59 +08:00 • committed by GitHub
parent 2b188521a1
commit 42f307ef6a
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -4,7 +4,7 @@ A hacky little script from Concedo that exposes llama.cpp function bindings, all
It's not very usable as there is a fundamental flaw with llama.cpp, which causes generation delay to scale linearly with original prompt length. Nobody knows why or really cares much, so I'm just going to publish whatever I have at this point. It's not very usable as there is a fundamental flaw with llama.cpp, which causes generation delay to scale linearly with original prompt length. Nobody knows why or really cares much, so I'm just going to publish whatever I have at this point.
If you care, please contribute to [this discussion](https://github.com/ggerganov/llama.cpp/discussions/229) which, if resolved, will actually make this viable. If you care, **please contribute to [this discussion](https://github.com/ggerganov/llama.cpp/discussions/229)** which, if resolved, will actually make this viable.
## Considerations ## Considerations
- Don't want to use pybind11 due to dependencies on MSVCC - Don't want to use pybind11 due to dependencies on MSVCC