From 6727cfd21ac3d3d14a21de690326552333de9ab8 Mon Sep 17 00:00:00 2001 From: Georgi Gerganov Date: Wed, 14 Feb 2024 09:35:57 +0200 Subject: [PATCH] llava : update readme a bit --- examples/llava/README.md | 6 ++++-- 1 file changed, 4 insertions(+), 2 deletions(-) diff --git a/examples/llava/README.md b/examples/llava/README.md index 4e789da3d..e2ef0eff1 100644 --- a/examples/llava/README.md +++ b/examples/llava/README.md @@ -19,9 +19,9 @@ After building, run: `./llava-cli` to see the usage. For example: **note**: A lower temperature like 0.1 is recommended for better quality. add `--temp 0.1` to the command to do so. -## Model conversion +## LLaVA 1.5 -- Clone `llava-v15-7b` and `clip-vit-large-patch14-336` locally: +- Clone a LLaVA and a CLIP model ([available options](https://github.com/haotian-liu/LLaVA/blob/main/docs/MODEL_ZOO.md)). For example: ```sh git clone https://huggingface.co/liuhaotian/llava-v1.5-7b @@ -59,6 +59,8 @@ Now both the LLaMA part and the image encoder is in the `llava-v1.5-7b` director - Use `llava-surgery-v2.py` +- TODO: add detailed instructions + ## TODO - [x] Support non-CPU backend for the image encoding part.