vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Added install instructions for latest python3

Browse source 
Added install instructions for the versions of `torch` and `sentencepiece` missing from the pip repo on the latest python3 - Used to get this working on Python 3.11.0
This commit is contained in:
Reelix 2023-03-15 23:32:01 +02:00 • committed by GitHub
parent 27944c4206
commit ae43513b39
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 6 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

6
README.md
View file

@ -140,6 +140,12 @@ ls ./models
# install Python dependencies
python3 -m pip install torch numpy sentencepiece
# For later versions of python3 that don't have official torch / sentencepiece packages on pip
# torch: pip3 install torch -f https://download.pytorch.org/whl/torch_stable.html
# sentencepiece
# 1.) https://github.com/google/sentencepiece/actions - Select the lastest passing build and download the artifact file (At the bottom)
# 2.) Copy \wheelhouse\sentencepiece-{Latest}-cp310-cp310-{YourOS_Architecture}.whl to your local folder
# 3.) pip3 install .\sentencepiece-from-above.whl
# convert the 7B model to ggml FP16 format
python3 convert-pth-to-ggml.py models/7B/ 1