TS_NS_IMPERIAL

Reported on 8 benchmarks across 1 task

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Reasoning8 results

Visual ReasoningonCLEVRER
Average-per ques.
69.21
best: 95.24 (AI Core)
Visual ReasoningonCLEVRER
Counterfactual-per opt.
78.08
best: 96.61 (AI Core)
Visual ReasoningonCLEVRER
Counterfactual-per ques.
44.6
best: 90.72 (AI Core)
Visual ReasoningonCLEVRER
Descriptive
89.95
best: 96.46 (AI Core)
Visual ReasoningonCLEVRER
Explanatory-per opt.
95.94
best: 99.94 (AI Core)
Visual ReasoningonCLEVRER
Explanatory-per ques.
91.98
best: 99.81 (AI Core)
Visual ReasoningonCLEVRER
Predictive-per opt.
74.73
best: 95.69 (redherring)
Visual ReasoningonCLEVRER
Predictive-per ques.
50.34
best: 93.96 (AI Core)