Remove model assign in main(). Clarified stop in README.
The model will now load the default from gptparams ("models/7B/ggml-model.bin")
This commit is contained in:
parent
7cdeb08483
commit
1a9141b6c3
2 changed files with 1 additions and 2 deletions
|
@ -110,7 +110,7 @@ node .
|
|||
|
||||
`prompt`: Provide a prompt. Internally, the prompt is compared, and it detects if a part has already been evaluated, and the remaining part will be evaluate.
|
||||
|
||||
`stop`: Specify the strings that indicate a stop.
|
||||
`stop`: Specify a JSON array of stopping strings.
|
||||
These words will not be included in the completion, so make sure to add them to the prompt for the next iteration (default: []).
|
||||
|
||||
`tfs_z`: Enable tail free sampling with parameter z (default: 1.0, 1.0 = disabled).
|
||||
|
|
|
@ -774,7 +774,6 @@ int main(int argc, char ** argv)
|
|||
|
||||
// struct that contains llama context and inference
|
||||
llama_server_context llama;
|
||||
params.model = "ggml-model.bin";
|
||||
|
||||
server_params_parse(argc, argv, sparams, params);
|
||||
|
||||
|
|
Loading…
Add table
Add a link
Reference in a new issue