MobileVLM-1.7B (w/o LoRA, w/ extra data)

Reported on 3 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision3 results

Image ClassificationonColonINST-v1 (Unseen)
Accuray· 2023-12-28
78.75
best: 83.24 (ColonGPT (w/ LoRA, w/o extra data))
MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devices arXiv:2312.16886
Referring expression generationonColonINST-v1 (Unseen)
Accuray· 2023-12-28
73.14
best: 80.18 (ColonGPT (w/ LoRA, w/o extra data))
MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devices arXiv:2312.16886
Referring expression generationonColonINST-v1 (Seen)
Accuray· 2023-12-28
97.78
best: 99.96 (ColonGPT (w/ LoRA, w/o extra data))
MobileVLM : A Fast, Strong and Open Vision Language Assistant for Mobile Devices arXiv:2312.16886