TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/Gemini Pro 1.5

Gemini Pro 1.5

Reported on 7 benchmarks across 1 task · 1 paper · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing7 results

  • Long-Context UnderstandingonMMNeedle
    1 Image, 8*8 Stitching, Exact Accuracy· 2024-03-08
    29.81
    SOTA
    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530
  • Long-Context UnderstandingonMMNeedle
    1 Image, 2*2 Stitching, Exact Accuracy· 2024-03-08
    90.34
    best: 94.6 (GPT-4o)
    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530
  • Long-Context UnderstandingonMMNeedle
    1 Image, 4*4 Stitching, Exact Accuracy· 2024-03-08
    39.85
    best: 83 (GPT-4o)
    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530
  • Long-Context UnderstandingonMMNeedle
    10 Images, 1*1 Stitching, Exact Accuracy· 2024-03-08
    89.94
    best: 97 (GPT-4o)
    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530
  • Long-Context UnderstandingonMMNeedle
    10 Images, 2*2 Stitching, Exact Accuracy· 2024-03-08
    45.21
    best: 81.8 (GPT-4o)
    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530
  • Long-Context UnderstandingonMMNeedle
    10 Images, 4*4 Stitching, Exact Accuracy· 2024-03-08
    6.09
    best: 26.9 (GPT-4o)
    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530
  • Long-Context UnderstandingonMMNeedle
    10 Images, 8*8 Stitching, Exact Accuracy· 2024-03-08
    0.62
    best: 1 (GPT-4o)
    Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextarXiv:2403.05530