Multimodal Deep Learning on VALSE foil-it (noun phrases)
Metric: pairwise accuracy (higher is better)
Metric: pairwise accuracy (higher is better)
| # | Model↕ | pairwise accuracy▼ | Augmentations | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | CLIP | 88.8 | No | VALSE: A Task-Independent Benchmark for Vision a... | 2021-12-14 | Code |
| 2 | LXMERT | 87.1 | No | VALSE: A Task-Independent Benchmark for Vision a... | 2021-12-14 | Code |
| 3 | ViLBERT 12-in-1 | 86.9 | No | VALSE: A Task-Independent Benchmark for Vision a... | 2021-12-14 | Code |
| 4 | ViLBERT | 86.9 | No | VALSE: A Task-Independent Benchmark for Vision a... | 2021-12-14 | Code |
| 5 | GPT2 | 80.7 | No | VALSE: A Task-Independent Benchmark for Vision a... | 2021-12-14 | Code |
| 6 | GPT1 | 77.5 | No | VALSE: A Task-Independent Benchmark for Vision a... | 2021-12-14 | Code |
| 7 | VisualBERT | 48.5 | No | VALSE: A Task-Independent Benchmark for Vision a... | 2021-12-14 | Code |