vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Add support for 30B model and 65B, if it is made in the future (#104)

Browse source
This commit is contained in:
Pi 2023-03-21 13:55:24 -07:00 • committed by GitHub
parent 7636ddb9e4
commit 428aa7025a
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 2 deletions
Download patch file Download diff file Expand all files Collapse all files

4
chat.cpp
View file

@ -32,8 +32,8 @@
static const std::map<int, int> LLAMA_N_PARTS = { static const std::map<int, int> LLAMA_N_PARTS = {
{ 4096, 1 }, { 4096, 1 },
{ 5120, 1 }, { 5120, 1 },
{ 6656, 4 }, { 6656, 1 },
{ 8192, 8 }, { 8192, 1 },
}; };
// default hparams (LLaMA 7B) // default hparams (LLaMA 7B)