Metric: Plausibility (higher is better)
| # | Model↕ | Plausibility▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | human | 97.2 | No | - | - | - |
| 2 | LSTM | 87.3 | No | - | - | - |
| 3 | 113 | 86.13 | No | - | - | - |
| 4 | Academia Sinica | 86.13 | No | - | - | - |
| 5 | Musan | 85.92 | No | - | - | - |
| 6 | Ensemble10 | 85.63 | No | - | - | - |
| 7 | BAN | 85.58 | No | - | - | - |
| 8 | MSM@MSRA | 85.49 | No | - | - | - |
| 9 | wcf-fight | 85.46 | No | - | - | - |
| 10 | GRN | 85.43 | No | Bilinear Graph Networks for Visual Question Answ... | 2019-07-23 | - |
| 11 | LININ | 85.38 | No | - | - | - |
| 12 | RES | 85.29 | No | - | - | - |
| 13 | happyTeam | 85.27 | No | - | - | - |
| 14 | LW | 85.27 | No | - | - | - |
| 15 | LXR955, Ensemble | 85.21 | No | LXMERT: Learning Cross-Modality Encoder Represen... | 2019-08-20 | Code |
| 16 | UJCNN | 85.2 | No | - | - | - |
| 17 | prompt IMT-16 | 85.19 | No | - | - | - |
| 18 | ZhaoLab | 85.19 | No | - | - | - |
| 19 | Single | 85.15 | No | - | - | - |
| 20 | vips | 85.15 | No | - | - | - |
| 21 | Fj | 85.12 | No | - | - | - |
| 22 | RD | 85.09 | No | - | - | - |
| 23 | 5TMT-qe+o | 85.05 | No | - | - | - |
| 24 | graphRepresentation, Single | 84.99 | No | - | - | - |
| 25 | Single Model | 84.98 | No | VinVL: Revisiting Visual Representations in Visi... | 2021-01-02 | Code |
| 26 | REX | 84.97 | No | - | - | - |
| 27 | mlmbert | 84.95 | No | - | - | - |
| 28 | DL16 | 84.94 | No | - | - | - |
| 29 | mcmi | 84.94 | No | - | - | - |
| 30 | fisher | 84.93 | No | - | - | - |
| 31 | VinVL-DPT | 84.91 | No | - | - | - |
| 32 | VinVL+L | 84.91 | No | - | - | Code |
| 33 | 1-gqa | 84.91 | No | - | - | - |
| 34 | DAM | 84.89 | No | - | - | - |
| 35 | result_run_2647872_epoch11 | 84.87 | No | - | - | - |
| 36 | glimple_all | 84.86 | No | - | - | - |
| 37 | F205 | 84.86 | No | - | - | - |
| 38 | UCM | 84.85 | No | - | - | - |
| 39 | VqaStar-UCAS-SARI | 84.85 | No | - | - | - |
| 40 | GM6_9_2_train | 84.85 | No | - | - | - |
| 41 | fbe20v3.json | 84.84 | No | - | - | - |
| 42 | GIN | 84.83 | No | - | - | - |
| 43 | lxmert-adv-txt | 84.82 | No | - | - | - |
| 44 | Coarse-to-Fine Reasoning, Single Model | 84.81 | No | - | - | - |
| 45 | LCGN | 84.81 | No | - | - | - |
| 46 | Deepblue_Semantics | 84.81 | No | - | - | - |
| 47 | lxmert-adv-txt | 84.8 | No | - | - | - |
| 48 | stu09e | 84.8 | No | - | - | - |
| 49 | Improved SNMN | 84.79 | No | - | - | - |
| 50 | LXMERT-S | 84.78 | No | - | - | - |
| 51 | Eden_test | 84.78 | No | - | - | - |
| 52 | PVR | 84.77 | No | - | - | - |
| 53 | Wayne | 84.74 | No | - | - | - |
| 54 | nogg | 84.74 | No | - | - | - |
| 55 | MLVQA (single) | 84.73 | No | - | - | - |
| 56 | gaochongyang9 | 84.72 | No | - | - | - |
| 57 | UCAS-SARI | 84.72 | No | - | - | - |
| 58 | rishabh_test | 84.71 | No | - | - | - |
| 59 | 45 | 84.69 | No | - | - | - |
| 60 | ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json | 84.68 | No | - | - | - |
| 61 | test | 84.67 | No | - | - | - |
| 62 | KU | 84.66 | No | - | - | - |
| 63 | test gqa | 84.6 | No | - | - | - |
| 64 | sparsemax15 | 84.58 | No | - | - | - |
| 65 | total14 | 84.57 | No | - | - | - |
| 66 | BottomUp | 84.57 | No | Bottom-Up and Top-Down Attention for Image Capti... | 2017-07-25 | Code |
| 67 | vv69 | 84.56 | No | - | - | - |
| 68 | bert_v1 | 84.56 | No | - | - | - |
| 69 | abc_test | 84.56 | No | - | - | - |
| 70 | Meta Module, Single | 84.55 | No | - | - | - |
| 71 | xpj | 84.55 | No | - | - | - |
| 72 | Inspur | 84.55 | No | - | - | - |
| 73 | HDU_ZWF | 84.55 | No | - | - | - |
| 74 | LXR955, Single Model | 84.53 | No | LXMERT: Learning Cross-Modality Encoder Represen... | 2019-08-20 | Code |
| 75 | Partial-MSP | 84.53 | No | - | - | - |
| 76 | gbert1 | 84.52 | No | - | - | - |
| 77 | LAS | 84.52 | No | - | - | - |
| 78 | rsa-14word | 84.5 | No | - | - | - |
| 79 | full_nsp_ft_results_submit_predict.json | 84.49 | No | - | - | - |
| 80 | DeeTee | 84.49 | No | - | - | - |
| 81 | MAC | 84.48 | No | - | - | - |
| 82 | TESTOVQA007 | 84.47 | No | - | - | - |
| 83 | tmp | 84.47 | No | - | - | - |
| 84 | Future_Test_team | 84.46 | No | - | - | - |
| 85 | SSRP | 84.46 | No | - | - | - |
| 86 | IIE_Morningstar | 84.45 | No | - | - | - |
| 87 | ST_VQA | 84.45 | No | - | - | - |
| 88 | UNITER + MAC + Graph Networks | 84.43 | No | - | - | - |
| 89 | Testify | 84.37 | No | - | - | - |
| 90 | LOGNet+VLR | 84.36 | No | - | - | - |
| 91 | Mithrandir | 84.35 | No | - | - | - |
| 92 | full_nsp_mlm_ft_joint_results_submit_predict.json | 84.34 | No | - | - | - |
| 93 | Sorbonne | 84.32 | No | - | - | - |
| 94 | LocalPrior | 84.31 | No | - | - | - |
| 95 | NSM single (updated) | 84.28 | No | - | - | - |
| 96 | ckpt 19 exp 90 | 84.27 | No | - | - | - |
| 97 | RSN (Single Model) | 84.25 | No | - | - | - |
| 98 | LSTM+CNN | 84.25 | No | - | - | - |
| 99 | RSN (Single Model)_v6 | 84.24 | No | - | - | - |
| 100 | BgTest | 84.2 | No | - | - | - |
| 101 | MMT-VQA | 84.2 | No | - | - | - |
| 102 | CHAIR | 84.2 | No | - | - | - |
| 103 | NSM ensemble (updated) | 84.16 | No | - | - | - |
| 104 | MDETR | 84.15 | No | - | - | - |
| 105 | Mycsulb | 84.13 | No | - | - | - |
| 106 | IQA (single) | 84.05 | No | - | - | - |
| 107 | IWantADonut | 84.04 | No | - | - | - |
| 108 | bear | 84.01 | No | - | - | - |
| 109 | mac_qin | 83.94 | No | - | - | - |
| 110 | mfb+bert | 83.93 | No | - | - | - |
| 111 | MIL-nbgao | 83.9 | No | - | - | - |
| 112 | Space Cat | 83.82 | No | - | - | - |
| 113 | 270 | 83.77 | No | - | - | - |
| 114 | Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep | 83.76 | No | - | - | - |
| 115 | DREAM+Unicoder-VL (MSRA) | 83.75 | No | - | - | - |
| 116 | Kakao Brain | 83.7 | No | - | - | - |
| 117 | happy | 83.69 | No | - | - | - |
| 118 | TRRNet (Ensemble) | 83.58 | No | - | - | - |
| 119 | MJ | 83.44 | No | - | - | - |
| 120 | RAM_BUGGY | 83.41 | No | - | - | - |
| 121 | QGCRGN | 82.76 | No | - | - | - |
| 122 | test | 81.75 | No | - | - | - |
| 123 | MReaL | 77.4 | No | - | - | - |
| 124 | Ediburgh-Mila-UCLA | 75.19 | No | - | - | - |
| 125 | GlobalPrior | 74.81 | No | - | - | - |
| 126 | muc_ai | 50.93 | No | - | - | - |
| 127 | CNN | 34.84 | No | - | - | - |