Commit graph

8 commits

Author SHA1 Message Date
Georgi Gerganov
d45c1631bc
metal : rewrite to fit new backend interface correctly (WIP) 2023-07-20 22:51:19 +03:00
Georgi Gerganov
290cb700bf
metal : map the CPU buffers to Metal buffers (WIP) 2023-07-20 14:30:34 +03:00
Georgi Gerganov
f38433ef5d
Merge remote-tracking branch 'origin/ggml-backends' into ggml-backends-metal 2023-07-19 17:45:45 +03:00
slaren
295f85654a allocators wip
renamed ggml_backend functions
changed ggml_buffer and ggml_backend to always be used as pointers
rename ggml_tensor::params -> op_params
2023-07-19 02:43:44 +02:00
Georgi Gerganov
652c849643
ggml : add is_ram_shared to ggml_backend
Metal can share the RAM memory and can utilize mmap without temp buffer
2023-07-18 18:51:02 +03:00
slaren
9c72e7e916 rebase to master (except ggml-cuda) 2023-07-16 15:10:46 +02:00
slaren
24cc6f008f minor fixes 2023-07-16 14:56:52 +02:00
slaren
0d2b66c638 ggml backend interface wip
refactor ggml-cuda
2023-07-16 14:56:46 +02:00