vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

ggml : various fixes (#1450)

Browse source 
- `ggml_rope()`
- `ggml_diag_mask_inf()` multi-threaded
- compatibility with scratch buffers
This commit is contained in:
Georgi Gerganov 2023-05-14 18:22:50 +03:00 • committed by GitHub
parent 60f8c361ca
commit 13c351ad72
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
2 changed files with 263 additions and 118 deletions
Download patch file Download diff file Expand all files Collapse all files

4
ggml.h
View file

@ -340,7 +340,7 @@ extern "C" {
// n-dimensional tensor
struct ggml_tensor {
enum ggml_type type;
enum ggml_type type;
enum ggml_backend backend;
int n_dims;
@ -372,7 +372,7 @@ extern "C" {
char name[32];
char padding[9]; // TODO: remove and add padding to name?
char padding[16];
};
// computation graph