Metric: Reasoning (Pro.) (higher is better)
| # | Model↕ | Reasoning (Pro.)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Patch-TRM | 95.73 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 2 | UNITER | 87.84 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 3 | ViLT | 87.65 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 4 | ViT | 86.07 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 5 | DFAF | 85.7 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 6 | MCAN | 84.87 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 7 | Top-Down | 83.75 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 8 | BAN | 82.45 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 9 | ViLBERT | 70.94 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 10 | Q-Only | 40.76 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 11 | Random | 38.81 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 12 | I-Only | 37.51 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |