Visual Question Answering (VQA) on GQA Test2019

Metric: Validity (higher is better)

LeaderboardDataset

Loading chart...

Results

#	Model↕	Validity▼	Extra Data	Paper	Date↕	Code
1	human	98.9	No	-	-	-
2	Coarse-to-Fine Reasoning, Single Model	96.77	No	-	-	-
3	TRRNet (Ensemble)	96.76	No	-	-	-
4	MIL-nbgao	96.73	No	-	-	-
5	270	96.65	No	-	-	-
6	VinVL-DPT	96.64	No	-	-	-
7	VinVL+L	96.62	No	-	-	Code
8	Single Model	96.62	No	VinVL: Revisiting Visual Representations in Visi...	2021-01-02	Code
9	113	96.61	No	-	-	-
10	LININ	96.57	No	-	-	-
11	Wayne	96.56	No	-	-	-
12	mcmi	96.56	No	-	-	-
13	DAM	96.55	No	-	-	-
14	NSM ensemble (updated)	96.53	No	-	-	-
15	mlmbert	96.5	No	-	-	-
16	PVR	96.5	No	-	-	-
17	LCGN	96.48	No	-	-	-
18	Single	96.47	No	-	-	-
19	1-gqa	96.46	No	-	-	-
20	REX	96.44	No	-	-	-
21	MSM@MSRA	96.43	No	-	-	-
22	LXMERT-S	96.43	No	-	-	-
23	DREAM+Unicoder-VL (MSRA)	96.42	No	-	-	-
24	NSM single (updated)	96.41	No	-	-	-
25	Musan	96.41	No	-	-	-
26	graphRepresentation， Single	96.4	No	-	-	-
27	F205	96.4	No	-	-	-
28	GIN	96.4	No	-	-	-
29	Eden_test	96.4	No	-	-	-
30	Deepblue_Semantics	96.39	No	-	-	-
31	5TMT-qe+o	96.39	No	-	-	-
32	LSTM	96.39	No	-	-	-
33	fisher	96.38	No	-	-	-
34	GM6_9_2_train	96.38	No	-	-	-
35	xpj	96.37	No	-	-	-
36	test gqa	96.37	No	-	-	-
37	wcf-fight	96.37	No	-	-	-
38	Improved SNMN	96.37	No	-	-	-
39	Kakao Brain	96.36	No	-	-	-
40	LXR955, Ensemble	96.36	No	LXMERT: Learning Cross-Modality Encoder Represen...	2019-08-20	Code
41	GRN	96.36	No	Bilinear Graph Networks for Visual Question Answ...	2019-07-23	-
42	lxmert-adv-txt	96.36	No	-	-	-
43	lxmert-adv-txt	96.36	No	-	-	-
44	Future_Test_team	96.36	No	-	-	-
45	tmp	96.36	No	-	-	-
46	test	96.36	No	-	-	-
47	ckpt 19 exp 90	96.35	No	-	-	-
48	45	96.35	No	-	-	-
49	Ensemble10	96.35	No	-	-	-
50	vv69	96.35	No	-	-	-
51	LXR955, Single Model	96.35	No	LXMERT: Learning Cross-Modality Encoder Represen...	2019-08-20	Code
52	Inspur	96.35	No	-	-	-
53	SSRP	96.35	No	-	-	-
54	nogg	96.35	No	-	-	-
55	KU	96.34	No	-	-	-
56	MDETR	96.33	No	-	-	-
57	UCM	96.33	No	-	-	-
58	IIE_Morningstar	96.33	No	-	-	-
59	TESTOVQA007	96.33	No	-	-	-
60	LW	96.33	No	-	-	-
61	abc_test	96.32	No	-	-	-
62	fbe20v3.json	96.31	No	-	-	-
63	full_nsp_ft_results_submit_predict.json	96.31	No	-	-	-
64	happyTeam	96.31	No	-	-	-
65	UNITER + MAC + Graph Networks	96.3	No	-	-	-
66	full_nsp_mlm_ft_joint_results_submit_predict.json	96.29	No	-	-	-
67	ZhaoLab	96.28	No	-	-	-
68	LOGNet+VLR	96.25	No	-	-	-
69	Mithrandir	96.25	No	-	-	-
70	DL16	96.24	No	-	-	-
71	BgTest	96.23	No	-	-	-
72	glimple_all	96.23	No	-	-	-
73	bert_v1	96.22	No	-	-	-
74	ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json	96.21	No	-	-	-
75	gaochongyang9	96.2	No	-	-	-
76	result_run_2647872_epoch11	96.2	No	-	-	-
77	UJCNN	96.2	No	-	-	-
78	Meta Module, Single	96.19	No	-	-	-
79	rishabh_test	96.18	No	-	-	-
80	gbert1	96.18	No	-	-	-
81	MLVQA (single)	96.18	No	-	-	-
82	IWantADonut	96.18	No	-	-	-
83	BottomUp	96.18	No	Bottom-Up and Top-Down Attention for Image Capti...	2017-07-25	Code
84	BAN	96.16	No	-	-	-
85	MAC	96.16	No	-	-	-
86	prompt IMT-16	96.15	No	-	-	-
87	RSN (Single Model)_v6	96.15	No	-	-	-
88	RES	96.15	No	-	-	-
89	Academia Sinica	96.14	No	-	-	-
90	Space Cat	96.12	No	-	-	-
91	VqaStar-UCAS-SARI	96.11	No	-	-	-
92	UCAS-SARI	96.08	No	-	-	-
93	stu09e	96.06	No	-	-	-
94	RSN (Single Model)	96.03	No	-	-	-
95	LSTM+CNN	96.02	No	-	-	-
96	MMT-VQA	96.01	No	-	-	-
97	ST_VQA	96.01	No	-	-	-
98	RD	96.01	No	-	-	-
99	IQA (single)	96	No	-	-	-
100	vips	95.99	No	-	-	-
101	Sorbonne	95.99	No	-	-	-
102	CHAIR	95.99	No	-	-	-
103	total14	95.98	No	-	-	-
104	Testify	95.94	No	-	-	-
105	HDU_ZWF	95.92	No	-	-	-
106	DeeTee	95.87	No	-	-	-
107	rsa-14word	95.86	No	-	-	-
108	happy	95.82	No	-	-	-
109	sparsemax15	95.78	No	-	-	-
110	Fj	95.76	No	-	-	-
111	mac_qin	95.75	No	-	-	-
112	mfb+bert	95.62	No	-	-	-
113	Partial-MSP	95.57	No	-	-	-
114	MJ	95.45	No	-	-	-
115	LAS	95.45	No	-	-	-
116	Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep	95.43	No	-	-	-
117	bear	95.32	No	-	-	-
118	Mycsulb	95.1	No	-	-	-
119	RAM_BUGGY	94.95	No	-	-	-
120	test	94.55	No	-	-	-
121	QGCRGN	93.82	No	-	-	-
122	MReaL	92.27	No	-	-	-
123	GlobalPrior	88.86	No	-	-	-
124	Ediburgh-Mila-UCLA	85.94	No	-	-	-
125	LocalPrior	84.33	No	-	-	-
126	muc_ai	60.81	No	-	-	-
127	CNN	35.78	No	-	-	-

Model↕

Validity▼

Extra Data

Paper

Date↕

Code

human

98.9

Coarse-to-Fine Reasoning, Single Model

96.77

TRRNet (Ensemble)

96.76

MIL-nbgao

96.73

270

96.65

VinVL-DPT

96.64

VinVL+L

96.62

Code

Single Model

96.62

VinVL: Revisiting Visual Representations in Visi...

2021-01-02

Code

113

96.61

LININ

96.57

Wayne

96.56

mcmi

96.56

DAM

96.55

NSM ensemble (updated)

96.53

mlmbert

96.5

PVR

96.5

LCGN

96.48

Single

96.47

1-gqa

96.46

REX

96.44

MSM@MSRA

96.43

LXMERT-S

96.43

DREAM+Unicoder-VL (MSRA)

96.42

NSM single (updated)

96.41

Musan

96.41

graphRepresentation， Single

96.4

F205

96.4

GIN

96.4

Eden_test

96.4

Deepblue_Semantics

96.39

5TMT-qe+o

96.39

LSTM

96.39

fisher

96.38

GM6_9_2_train

96.38

xpj

96.37

test gqa

96.37

wcf-fight

96.37

Improved SNMN

96.37

Kakao Brain

96.36

LXR955, Ensemble

96.36

LXMERT: Learning Cross-Modality Encoder Represen...

2019-08-20

Code

GRN

96.36

Bilinear Graph Networks for Visual Question Answ...

2019-07-23

lxmert-adv-txt

96.36

lxmert-adv-txt

96.36

Future_Test_team

96.36

tmp

96.36

test

96.36

ckpt 19 exp 90

96.35

Ensemble10

96.35

vv69

96.35

LXR955, Single Model

96.35

LXMERT: Learning Cross-Modality Encoder Represen...

2019-08-20

Code

Inspur

96.35

SSRP

96.35

nogg

96.35

96.34

MDETR

96.33

UCM

96.33

IIE_Morningstar

96.33

TESTOVQA007

96.33

abc_test

96.32

fbe20v3.json

96.31

full_nsp_ft_results_submit_predict.json

96.31

happyTeam

96.31

UNITER + MAC + Graph Networks

96.3

full_nsp_mlm_ft_joint_results_submit_predict.json

96.29

ZhaoLab

96.28

LOGNet+VLR

96.25

Mithrandir

96.25

DL16

96.24

BgTest

96.23

glimple_all

96.23

bert_v1

96.22

ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json

96.21

gaochongyang9

96.2

result_run_2647872_epoch11

96.2

UJCNN

96.2

Meta Module, Single

96.19

rishabh_test

96.18

gbert1

96.18

MLVQA (single)

96.18

IWantADonut

96.18

BottomUp

96.18

Bottom-Up and Top-Down Attention for Image Capti...

2017-07-25

Code

BAN

96.16

MAC

96.16

prompt IMT-16

96.15

RSN (Single Model)_v6

96.15

RES

96.15

Academia Sinica

96.14

Space Cat

96.12

VqaStar-UCAS-SARI

96.11

UCAS-SARI

96.08

stu09e

96.06

RSN (Single Model)

96.03

LSTM+CNN

96.02

MMT-VQA

96.01

ST_VQA

96.01

IQA (single)

100

vips

95.99

101

Sorbonne

95.99

102

CHAIR

95.99

103

total14

95.98

104

Testify

95.94

105

HDU_ZWF

95.92

106

DeeTee

95.87

107

rsa-14word

95.86

108

happy

95.82

109

sparsemax15

95.78

110

95.76

111

mac_qin

95.75

112

mfb+bert

95.62

113

Partial-MSP

95.57

114

95.45

115

LAS

95.45

116

Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep

95.43

117

bear

95.32

118

Mycsulb

95.1

119

RAM_BUGGY

94.95

120

test

94.55

121

QGCRGN

93.82

122

MReaL

92.27

123

GlobalPrior

88.86

124

Ediburgh-Mila-UCLA

85.94

125

LocalPrior

84.33

126

muc_ai

60.81

127

CNN

35.78