vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update README.md

Browse source
This commit is contained in:
Eve 2023-08-08 22:58:53 -04:00 • committed by GitHub
parent 3919e67421
commit 49f0bfd69d
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
examples/main/README.md
View file

@ -259,6 +259,7 @@ These options help improve the performance and memory usage of the LLaMA models.
### Number of Threads ### Number of Threads
- `-t N, --threads N`: Set the number of threads to use during computation. For optimal performance, it is recommended to set this value to the number of physical CPU cores your system has (as opposed to the logical number of cores). Using the correct number of threads can greatly improve performance. - `-t N, --threads N`: Set the number of threads to use during computation. For optimal performance, it is recommended to set this value to the number of physical CPU cores your system has (as opposed to the logical number of cores). Using the correct number of threads can greatly improve performance.
- `-ppt N, --pp-threads N`: Set the number of threads to use during prompt processing only.
### Mlock ### Mlock