diff --git a/examples/llava/README.md b/examples/llava/README.md index 4e789da3d..e2ef0eff1 100644 --- a/examples/llava/README.md +++ b/examples/llava/README.md @@ -19,9 +19,9 @@ After building, run: `./llava-cli` to see the usage. For example: **note**: A lower temperature like 0.1 is recommended for better quality. add `--temp 0.1` to the command to do so. -## Model conversion +## LLaVA 1.5 -- Clone `llava-v15-7b` and `clip-vit-large-patch14-336` locally: +- Clone a LLaVA and a CLIP model ([available options](https://github.com/haotian-liu/LLaVA/blob/main/docs/MODEL_ZOO.md)). For example: ```sh git clone https://huggingface.co/liuhaotian/llava-v1.5-7b @@ -59,6 +59,8 @@ Now both the LLaMA part and the image encoder is in the `llava-v1.5-7b` director - Use `llava-surgery-v2.py` +- TODO: add detailed instructions + ## TODO - [x] Support non-CPU backend for the image encoding part.