From 4be9750d49fec5fd076e85b4a5f4ef8b0a9343fb Mon Sep 17 00:00:00 2001 From: Pierrick HYMBERT Date: Tue, 9 Apr 2024 16:34:55 +0200 Subject: [PATCH] docs: model: add prevision on RoPE --- docs/HOWTO-add-model.md | 1 + 1 file changed, 1 insertion(+) diff --git a/docs/HOWTO-add-model.md b/docs/HOWTO-add-model.md index 1c9dc5acc..820cd6c37 100644 --- a/docs/HOWTO-add-model.md +++ b/docs/HOWTO-add-model.md @@ -95,6 +95,7 @@ The model params and tensors layout must be defined in `llama.cpp`: 2. Define the tensors layout in `LLM_TENSOR_NAMES` 3. Add any non standard metadata in `llm_load_hparams` 4. Create the tensors for inference in `llm_load_tensors` +5. If the model has a RoPE operation, add the rope type in `llama_rope_type` NOTE: The dimensions in `ggml` are typically in the reverse order of the `pytorch` dimensions.