Gemini Pro

Reported on 2 benchmarks across 1 task · 2 papers

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning2 results

Multimodal ReasoningonMATH-V
Accuracy· uses extra data· 2024-02-22
17.66
best: 22.76 (GPT4V)
Measuring Multimodal Mathematical Reasoning with MATH-Vision Dataset arXiv:2402.14804
Multimodal ReasoningonREBUS
Accuracy· 2024-01-11
13.2
best: 24 (GPT-4V)
REBUS: A Robust Evaluation Benchmark of Understanding Symbols arXiv:2401.05604