vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update README.md

Browse source
This commit is contained in:
zeyu 2023-12-19 10:52:54 +08:00 • committed by GitHub
parent 53268cbb52
commit dc0552b1b4
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
README.md
View file

@ -124,7 +124,7 @@ Then, you can use the following instructions to run PowerInfer with GPU index:
![github-eval-2080ti-q4](https://github.com/SJTU-IPADS/PowerInfer/assets/34213478/0fc1bfc4-aafc-4e82-a865-bec0143aff1a) ![github-eval-2080ti-q4](https://github.com/SJTU-IPADS/PowerInfer/assets/34213478/0fc1bfc4-aafc-4e82-a865-bec0143aff1a)
PowerInfer achieves up to 11.69x and 8.00x speedup for FP16 and INT4 models! PowerInfer achieves up to 11x and 8x speedup for FP16 and INT4 models!
## TODOs ## TODOs
We will release the code and data in the following order, please stay tuned! We will release the code and data in the following order, please stay tuned!