vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

python/pytorch compat notes (#44)

Browse source
This commit is contained in:
Oleksandr Nikitin 2023-03-12 14:16:33 +02:00 • committed by GitHub
parent 129c7d1ea8
commit b9bd1d0141
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 2 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

1
README.md
View file

@ -136,6 +136,7 @@ ls ./models
65B 30B 13B 7B tokenizer_checklist.chk tokenizer.model
# install Python dependencies
# preferred versions: python 3.10 (not 3.11), torch 1.13.1+
python3 -m pip install torch numpy sentencepiece
# convert the 7B model to ggml FP16 format