2 commits

Author	SHA1	Message	Date
Olivier Chafik	ab5efbb3b6	Prefix all example bins w/ llama-	2024-06-08 13:42:01 +01:00
Georgi Gerganov	8c70a5ff25	batched : add bench tool (#3545) ... * batched : add bench tool * batched : minor fix table * batched-bench : add readme + n_kv_max is now configurable * batched-bench : init warm-up batch * batched-bench : pass custom set of PP, TG and PL * batched-bench : add mmq CLI arg	2023-10-11 21:25:33 +03:00