Gemini 1.5 Flash

Reported on 4 benchmarks across 2 tasks · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing2 results

Question AnsweringonVideo-MME (w/o subs)
Accuracy (%)· 2024-03-08
66.3
best: 77.4 (Video-RAG (based on LLaVA-Video))
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context arXiv:2403.05530
Question AnsweringonVideo-MME
Accuracy (%)· 2024-03-08
75
best: 81.3 (Gemini 1.5 Pro)
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context arXiv:2403.05530

Reasoning2 results

Video Question AnsweringonVideo-MME (w/o subs)
Accuracy (%)· 2024-03-08
66.3
best: 77.4 (Video-RAG (based on LLaVA-Video))
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context arXiv:2403.05530
Video Question AnsweringonVideo-MME
Accuracy (%)· 2024-03-08
75
best: 81.3 (Gemini 1.5 Pro)
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context arXiv:2403.05530