vbatts/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

ggml : ggml_get_rows support 2D indexing [n_tokens, n_experts] (cpu only)

Browse source
This commit is contained in:
Georgi Gerganov 2023-12-09 13:18:58 +02:00
parent 8b185b7030
commit 7372b62271
No known key found for this signature in database
GPG key ID: 449E073F9DC10735
2 changed files with 10 additions and 8 deletions
Download patch file Download diff file Expand all files Collapse all files

1
ggml.h
View file

@ -1263,6 +1263,7 @@ extern "C" {
struct ggml_context * ctx,
struct ggml_tensor * a);
// supports 3D: a->ne[2] == b->ne[1]
GGML_API struct ggml_tensor * ggml_get_rows(
struct ggml_context * ctx,
struct ggml_tensor * a,