Metric: Reasoning (Sce.) (higher is better)
| # | Model↕ | Reasoning (Sce.)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | ViT | 68.8 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 2 | DFAF | 67.01 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 3 | BAN | 66.92 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 4 | ViLT | 66.72 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 5 | MCAN | 62.49 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 6 | Patch-TRM | 62.39 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 7 | UNITER | 61.25 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 8 | ViLBERT | 58.52 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 9 | Top-Down | 58.22 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 10 | I-Only | 35.47 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 11 | Q-Only | 35.37 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 12 | Random | 34.25 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |