PaLI (ft SNLI-VE)

Reported on 3 benchmarks across 1 task · 1 paper

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning3 results

Visual ReasoningonWinoground
Group Score· 2023-05-17
28.7
best: 58.75 (GPT-4V (CoT, pick b/w two options))
What You See is What You Read? Improving Text-Image Alignment Evaluation arXiv:2305.10400
Visual ReasoningonWinoground
Image Score· 2023-05-17
41.5
best: 68.75 (GPT-4V (CoT, pick b/w two options))
What You See is What You Read? Improving Text-Image Alignment Evaluation arXiv:2305.10400
Visual ReasoningonWinoground
Text Score· 2023-05-17
45
best: 75.5 (GPT-4o + CA)
What You See is What You Read? Improving Text-Image Alignment Evaluation arXiv:2305.10400