Skip to content

Commit ef0bc7a

Browse files
committed
update llava/readme
1 parent 6e31ddc commit ef0bc7a

File tree

1 file changed

+10
-8
lines changed

1 file changed

+10
-8
lines changed

examples/llava/README.md

Lines changed: 10 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -67,7 +67,16 @@ Built upon `clip.cpp` (similar to `llava.cpp`), `libmtmd` offers several advanta
6767

6868
## How to obtain `mmproj`
6969

70-
Multimodal projector (`mmproj`) files are specific to each model architecture. Please refer to the relevant guide for instructions on how to obtain or create them:
70+
Multimodal projector (`mmproj`) files are specific to each model architecture.
71+
72+
For the following models, you can use `convert_hf_to_gguf.py`with `--mmproj` flag to get the `mmproj` file:
73+
- [Gemma 3](https://huggingface.co/collections/google/gemma-3-release-67c6c6f89c4f76621268bb6d) - Note: 1B variant does not have vision support
74+
- SmolVLM (from [HuggingFaceTB](https://huggingface.co/HuggingFaceTB))
75+
- SmolVLM2 (from [HuggingFaceTB](https://huggingface.co/HuggingFaceTB))
76+
- [Pixtral 12B](https://huggingface.co/mistral-community/pixtral-12b) - only works with `transformers`-compatible checkpoint
77+
- Qwen 2 VL and Qwen 2.5 VL
78+
79+
For older models, please refer to the relevant guide for instructions on how to obtain or create them:
7180

7281
- [LLaVA](../../docs/multimodal/llava.md)
7382
- [MobileVLM](../../docs/multimodal/MobileVLM.md)
@@ -76,10 +85,3 @@ Multimodal projector (`mmproj`) files are specific to each model architecture. P
7685
- [MiniCPM-V 2.6](../../docs/multimodal/minicpmv2.6.md)
7786
- [MiniCPM-o 2.6](../../docs/multimodal/minicpmo2.6.md)
7887
- [IBM Granite Vision](../../docs/multimodal/granitevision.md)
79-
- [Google Gemma 3](../../docs/multimodal/gemma3.md)
80-
81-
For the following models, you can use `convert_hf_to_gguf.py`with `--mmproj` flag to get the `mmproj` file:
82-
- [Gemma 3](https://huggingface.co/collections/google/gemma-3-release-67c6c6f89c4f76621268bb6d) - Note: 1B variant does not have vision support
83-
- SmolVLM (from [HuggingFaceTB](https://huggingface.co/HuggingFaceTB))
84-
- SmolVLM2 (from [HuggingFaceTB](https://huggingface.co/HuggingFaceTB))
85-
- [Pixtral 12B](https://huggingface.co/mistral-community/pixtral-12b) - only works with `transformers`-compatible checkpoint

0 commit comments

Comments
 (0)