vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Add --ctx param to Prepare Data & Run section

Browse source
This commit is contained in:
akawrykow 2023-08-22 17:48:48 -07:00
parent 6b9478ccd5
commit 4f8d62e444
1 changed files with 2 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

3
README.md
View file

@ -514,7 +514,8 @@ ls ./models
python3 -m pip install -r requirements.txt python3 -m pip install -r requirements.txt
# convert the 7B model to ggml FP16 format # convert the 7B model to ggml FP16 format
python3 convert.py models/7B/ # Use --ctx 4096 for LLaMA v2
python3 convert.py models/7B/ --ctx 2048
# [Optional] for models using BPE tokenizers # [Optional] for models using BPE tokenizers
python convert.py models/7B/ --vocabtype bpe python convert.py models/7B/ --vocabtype bpe