Metric: Reasoning (Com.) (higher is better)
| # | Model↕ | Reasoning (Com.)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Patch-TRM | 87 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 2 | ViLT | 84.95 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 3 | UNITER | 83.67 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 4 | MCAN | 82.73 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 5 | ViT | 82.12 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 6 | BAN | 82.12 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 7 | DFAF | 81.69 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 8 | Top-Down | 80.65 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 9 | ViLBERT | 75.6 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 10 | Q-Only | 48.19 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 11 | I-Only | 45.26 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 12 | Random | 41.2 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |