Claude-3.5-Sonnet

Reported on 3 benchmarks across 3 tasks · 1 paper · 3 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing3 results

Question AnsweringonMapEval-Textual
Accuracy (% )· 2024-12-31
66.33
SOTA
MapEval: A Map-Based Evaluation of Geo-Spatial Reasoning in Foundation Models arXiv:2501.00316
Visual Question Answering (VQA)onMapEval-Visual
Accuracy (% )· 2024-12-31
61.65
SOTA
MapEval: A Map-Based Evaluation of Geo-Spatial Reasoning in Foundation Models arXiv:2501.00316
Visual Question AnsweringonMapEval-Visual
Accuracy (% )· 2024-12-31
61.65
SOTA
MapEval: A Map-Based Evaluation of Geo-Spatial Reasoning in Foundation Models arXiv:2501.00316