vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Update README for consistency

Browse source
This commit is contained in:
kalomaze 2023-10-31 13:18:48 -05:00
parent 512cac630c
commit 974640ac25
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
examples/main/README.md
View file

@ -212,7 +212,7 @@ Example usage: `--top-p 0.95`
- `--min-p N`: Sets a minimum base probability threshold for token selection (default: 0.0). - `--min-p N`: Sets a minimum base probability threshold for token selection (default: 0.0).
Min-P sampling is a sampling method where the value represents the base required probability percentage. This value is scaled down based on the probability of the most likely token. For example, with a Min-P value set at 0.05 and the highest token probability being 90%, the percentage requirement threshold becomes 4.5%. This approach ensures a balance of quality and variety in the results, and was designed as an alternative to improve upon Top P. The default value is 0.05. The Min-P sampling method was designed as an alternative to Top-P, and aims to ensure a balance of quality and variety. The parameter *p* represents the minimum probability for a token to be considered, relative to the probability of the most likely token. For example, with *p*=0.05 and the most likely token having a probability of 0.9, logits with a value less than 0.045 are filtered out.
Example usage: `--min-p 0.05` Example usage: `--min-p 0.05`