Metric: Reasoning (Tim.) (higher is better)
| # | Model↕ | Reasoning (Tim.)▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | Patch-TRM | 77.98 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 2 | ViLT | 69.99 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 3 | UNITER | 69.77 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 4 | ViT | 68.66 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 5 | Top-Down | 68.28 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 6 | MCAN | 68 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 7 | DFAF | 67.72 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 8 | ViLBERT | 66.72 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 9 | BAN | 66.5 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 10 | Q-Only | 48.09 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 11 | I-Only | 47.37 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |
| 12 | Random | 35.82 | No | IconQA: A New Benchmark for Abstract Diagram Und... | 2021-10-25 | Code |