From 06703820dcfce6598f5051b977a74e77ea0e9d4b Mon Sep 17 00:00:00 2001 From: Alex-Brooks Date: Mon, 10 Feb 2025 07:23:07 -0700 Subject: [PATCH] Fix notes rendering Signed-off-by: Alex-Brooks --- examples/llava/README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/examples/llava/README.md b/examples/llava/README.md index 57684b623..0e3c32032 100644 --- a/examples/llava/README.md +++ b/examples/llava/README.md @@ -101,7 +101,9 @@ python ./examples/convert_legacy_llama.py ../llava-v1.6-vicuna-7b/ --skip-unknow ``` **note** llava-1.6 needs more context than llava-1.5, at least 3000 is needed (just run it at -c 4096) + **note** llava-1.6 greatly benefits from batched prompt processing (defaults work) + **note** if the language model in step `6)` is incompatible with the legacy conversion script, the easiest way handle the LLM model conversion is to load the model in transformers, and export only the LLM from the llava next model. ```python