vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Fix a bug in the rope calculation

Browse source
This commit is contained in:
Georgi Gerganov 2023-03-10 23:46:39 +02:00
parent 18ebda34d6
commit 70bc0b8b15
No known key found for this signature in database
GPG key ID: 449E073F9DC10735
4 changed files with 92 additions and 6 deletions
Download patch file Download diff file Expand all files Collapse all files

2
convert-pth-to-ggml.py
View file

@ -73,7 +73,7 @@ fout.write(struct.pack("i", hparams["dim"]))
fout.write(struct.pack("i", hparams["multiple_of"]))
fout.write(struct.pack("i", hparams["n_heads"]))
fout.write(struct.pack("i", hparams["n_layers"]))
fout.write(struct.pack("i", 64)) # rot
fout.write(struct.pack("i", hparams["dim"] // hparams["n_heads"])) # rot (obsolete)
fout.write(struct.pack("i", ftype))
# Is this correct??