Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Gemini Pro 1.0

Gemini Pro 1.0

Reported on 7 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing7 results

Long-Context UnderstandingonMMNeedle
1 Image, 2*2 Stitching, Exact Accuracy· 2023-12-19
29.53
best: 94.6 (GPT-4o)
Gemini: A Family of Highly Capable Multimodal Models arXiv:2312.11805
Long-Context UnderstandingonMMNeedle
1 Image, 4*4 Stitching, Exact Accuracy· 2023-12-19
24.78
best: 83 (GPT-4o)
Gemini: A Family of Highly Capable Multimodal Models arXiv:2312.11805
Long-Context UnderstandingonMMNeedle
1 Image, 8*8 Stitching, Exact Accuracy· 2023-12-19
2.11
best: 29.81 (Gemini Pro 1.5)
Gemini: A Family of Highly Capable Multimodal Models arXiv:2312.11805
Long-Context UnderstandingonMMNeedle
10 Images, 1*1 Stitching, Exact Accuracy· 2023-12-19
16.25
best: 97 (GPT-4o)
Gemini: A Family of Highly Capable Multimodal Models arXiv:2312.11805
Long-Context UnderstandingonMMNeedle
10 Images, 2*2 Stitching, Exact Accuracy· 2023-12-19
4.82
best: 81.8 (GPT-4o)
Gemini: A Family of Highly Capable Multimodal Models arXiv:2312.11805
Long-Context UnderstandingonMMNeedle
10 Images, 4*4 Stitching, Exact Accuracy· 2023-12-19
0.4
best: 26.9 (GPT-4o)
Gemini: A Family of Highly Capable Multimodal Models arXiv:2312.11805
Long-Context UnderstandingonMMNeedle
10 Images, 8*8 Stitching, Exact Accuracy
0
best: 1 (GPT-4o)