Visual Question Answering (VQA) on GQA Test2019

Metric: Open (higher is better)

LeaderboardDataset

Loading chart...

Results

#	Model↕	Open▼	Extra Data	Paper	Date↕	Code
1	human	87.4	No	-	-	-
2	DREAM+Unicoder-VL (MSRA)	68.6	No	-	-	-
3	Kakao Brain	67.73	No	-	-	-
4	MIL-nbgao	67.64	No	-	-	-
5	TRRNet (Ensemble)	66.89	No	-	-	-
6	Coarse-to-Fine Reasoning, Single Model	64.19	No	-	-	-
7	270	63.82	No	-	-	-
8	NSM ensemble (updated)	56.16	No	-	-	-
9	Single	50.22	No	-	-	-
10	VinVL-DPT	49.29	No	-	-	-
11	NSM single (updated)	49.25	No	-	-	-
12	VinVL+L	49.19	No	-	-	Code
13	Wayne	49.03	No	-	-	-
14	Single Model	48.77	No	VinVL: Revisiting Visual Representations in Visi...	2021-01-02	Code
15	LXR955, Ensemble	47.64	No	LXMERT: Learning Cross-Modality Encoder Represen...	2019-08-20	Code
16	1-gqa	46.69	No	-	-	-
17	UCM	46.56	No	-	-	-
18	fisher	46.55	No	-	-	-
19	MSM@MSRA	46.3	No	-	-	-
20	lxmert-adv-txt	46.19	No	-	-	-
21	lxmert-adv-txt	46.16	No	-	-	-
22	MDETR	46.15	No	-	-	-
23	mlmbert	46.06	No	-	-	-
24	prompt IMT-16	46.06	No	-	-	-
25	45	46.01	No	-	-	-
26	xpj	45.96	No	-	-	-
27	GRN	45.81	No	Bilinear Graph Networks for Visual Question Answ...	2019-07-23	-
28	IQA (single)	45.73	No	-	-	-
29	vv69	45.68	No	-	-	-
30	bert_v1	45.61	No	-	-	-
31	full_nsp_mlm_ft_joint_results_submit_predict.json	45.59	No	-	-	-
32	ckpt 19 exp 90	45.54	No	-	-	-
33	full_nsp_ft_results_submit_predict.json	45.51	No	-	-	-
34	test gqa	45.48	No	-	-	-
35	LXR955, Single Model	45.47	No	LXMERT: Learning Cross-Modality Encoder Represen...	2019-08-20	Code
36	IIE_Morningstar	45.41	No	-	-	-
37	fbe20v3.json	45.36	No	-	-	-
38	TESTOVQA007	45.36	No	-	-	-
39	Inspur	45.27	No	-	-	-
40	SSRP	45.21	No	-	-	-
41	Future_Test_team	45.14	No	-	-	-
42	tmp	45.12	No	-	-	-
43	Meta Module, Single	44.89	No	-	-	-
44	gaochongyang9	44.89	No	-	-	-
45	BgTest	44.85	No	-	-	-
46	LININ	44.83	No	-	-	-
47	Ensemble10	44.76	No	-	-	-
48	glimple_all	44.58	No	-	-	-
49	QGCRGN	44.04	No	-	-	-
50	mcmi	43.82	No	-	-	-
51	PVR	43.75	No	-	-	-
52	gbert1	43.75	No	-	-	-
53	DAM	43.61	No	-	-	-
54	LXMERT-S	43.6	No	-	-	-
55	UNITER + MAC + Graph Networks	43.38	No	-	-	-
56	rishabh_test	43.35	No	-	-	-
57	DL16	43.26	No	-	-	-
58	graphRepresentation， Single	43.19	No	-	-	-
59	ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json	43.11	No	-	-	-
60	Musan	43.02	No	-	-	-
61	UCAS-SARI	42.57	No	-	-	-
62	LCGN	42.33	No	-	-	-
63	VqaStar-UCAS-SARI	42.26	No	-	-	-
64	MLVQA (single)	42.14	No	-	-	-
65	F205	42.11	No	-	-	-
66	stu09e	42	No	-	-	-
67	result_run_2647872_epoch11	41.99	No	-	-	-
68	RD	41.93	No	-	-	-
69	REX	41.86	No	-	-	-
70	rsa-14word	41.71	No	-	-	-
71	happyTeam	41.7	No	-	-	-
72	Partial-MSP	41.67	No	-	-	-
73	Testify	41.64	No	-	-	-
74	LOGNet+VLR	41.52	No	-	-	-
75	IWantADonut	41.47	No	-	-	-
76	total14	41.36	No	-	-	-
77	RSN (Single Model)	41.32	No	-	-	-
78	DeeTee	41.31	No	-	-	-
79	GM6_9_2_train	41.06	No	-	-	-
80	wcf-fight	41.02	No	-	-	-
81	ZhaoLab	40.97	No	-	-	-
82	MMT-VQA	40.87	No	-	-	-
83	Improved SNMN	40.82	No	-	-	-
84	GIN	40.8	No	-	-	-
85	vips	40.79	No	-	-	-
86	RSN (Single Model)_v6	40.74	No	-	-	-
87	Deepblue_Semantics	40.53	No	-	-	-
88	LW	40.46	No	-	-	-
89	BAN	40.41	No	-	-	-
90	ST_VQA	40.2	No	-	-	-
91	Eden_test	40.14	No	-	-	-
92	Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep	40.09	No	-	-	-
93	abc_test	40.08	No	-	-	-
94	nogg	39.99	No	-	-	-
95	KU	39.92	No	-	-	-
96	HDU_ZWF	39.23	No	-	-	-
97	test	38.94	No	-	-	-
98	MAC	38.91	No	-	-	-
99	mac_qin	38.5	No	-	-	-
100	Sorbonne	38.23	No	-	-	-
101	UJCNN	38.04	No	-	-	-
102	Mithrandir	37.64	No	-	-	-
103	5TMT-qe+o	37.44	No	-	-	-
104	test	37.34	No	-	-	-
105	MJ	37.22	No	-	-	-
106	happy	37.11	No	-	-	-
107	mfb+bert	35.83	No	-	-	-
108	Space Cat	35.2	No	-	-	-
109	BottomUp	34.83	No	Bottom-Up and Top-Down Attention for Image Capti...	2017-07-25	Code
110	sparsemax15	34	No	-	-	-
111	RES	33.81	No	-	-	-
112	RAM_BUGGY	33.12	No	-	-	-
113	Ediburgh-Mila-UCLA	32.13	No	-	-	-
114	LSTM+CNN	31.8	No	-	-	-
115	LAS	31.34	No	-	-	-
116	bear	30.24	No	-	-	-
117	MReaL	29.73	No	-	-	-
118	113	29.2	No	-	-	-
119	CHAIR	26.45	No	-	-	-
120	LSTM	22.69	No	-	-	-
121	Academia Sinica	21.88	No	-	-	-
122	Mycsulb	20.44	No	-	-	-
123	Fj	19.74	No	-	-	-
124	LocalPrior	16.66	No	-	-	-
125	GlobalPrior	16.62	No	-	-	-
126	muc_ai	9.47	No	-	-	-
127	CNN	1.74	No	-	-	-

Model↕

Open▼

Extra Data

Paper

Date↕

Code

human

87.4

DREAM+Unicoder-VL (MSRA)

68.6

Kakao Brain

67.73

MIL-nbgao

67.64

TRRNet (Ensemble)

66.89

Coarse-to-Fine Reasoning, Single Model

64.19

270

63.82

NSM ensemble (updated)

56.16

Single

50.22

VinVL-DPT

49.29

NSM single (updated)

49.25

VinVL+L

49.19

Code

Wayne

49.03

Single Model

48.77

VinVL: Revisiting Visual Representations in Visi...

2021-01-02

Code

LXR955, Ensemble

47.64

LXMERT: Learning Cross-Modality Encoder Represen...

2019-08-20

Code

1-gqa

46.69

UCM

46.56

fisher

46.55

MSM@MSRA

46.3

lxmert-adv-txt

46.19

lxmert-adv-txt

46.16

MDETR

46.15

mlmbert

46.06

prompt IMT-16

46.06

46.01

xpj

45.96

GRN

45.81

Bilinear Graph Networks for Visual Question Answ...

2019-07-23

IQA (single)

45.73

vv69

45.68

bert_v1

45.61

full_nsp_mlm_ft_joint_results_submit_predict.json

45.59

ckpt 19 exp 90

45.54

full_nsp_ft_results_submit_predict.json

45.51

test gqa

45.48

LXR955, Single Model

45.47

LXMERT: Learning Cross-Modality Encoder Represen...

2019-08-20

Code

IIE_Morningstar

45.41

fbe20v3.json

45.36

TESTOVQA007

45.36

Inspur

45.27

SSRP

45.21

Future_Test_team

45.14

tmp

45.12

Meta Module, Single

44.89

gaochongyang9

44.89

BgTest

44.85

LININ

44.83

Ensemble10

44.76

glimple_all

44.58

QGCRGN

44.04

mcmi

43.82

PVR

43.75

gbert1

43.75

DAM

43.61

LXMERT-S

43.6

UNITER + MAC + Graph Networks

43.38

rishabh_test

43.35

DL16

43.26

graphRepresentation， Single

43.19

ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json

43.11

Musan

43.02

UCAS-SARI

42.57

LCGN

42.33

VqaStar-UCAS-SARI

42.26

MLVQA (single)

42.14

F205

42.11

stu09e

result_run_2647872_epoch11

41.99

41.93

REX

41.86

rsa-14word

41.71

happyTeam

41.7

Partial-MSP

41.67

Testify

41.64

LOGNet+VLR

41.52

IWantADonut

41.47

total14

41.36

RSN (Single Model)

41.32

DeeTee

41.31

GM6_9_2_train

41.06

wcf-fight

41.02

ZhaoLab

40.97

MMT-VQA

40.87

Improved SNMN

40.82

GIN

40.8

vips

40.79

RSN (Single Model)_v6

40.74

Deepblue_Semantics

40.53

40.46

BAN

40.41

ST_VQA

40.2

Eden_test

40.14

Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep

40.09

abc_test

40.08

nogg

39.99

39.92

HDU_ZWF

39.23

test

38.94

MAC

38.91

mac_qin

38.5

100

Sorbonne

38.23

101

UJCNN

38.04

102

Mithrandir

37.64

103

5TMT-qe+o

37.44

104

test

37.34

105

37.22

106

happy

37.11

107

mfb+bert

35.83

108

Space Cat

35.2

109

BottomUp

34.83

Bottom-Up and Top-Down Attention for Image Capti...

2017-07-25

Code

110

sparsemax15

111

RES

33.81

112

RAM_BUGGY

33.12

113

Ediburgh-Mila-UCLA

32.13

114

LSTM+CNN

31.8

115

LAS

31.34

116

bear

30.24

117

MReaL

29.73

118

113

29.2

119

CHAIR

26.45

120

LSTM

22.69

121

Academia Sinica

21.88

122

Mycsulb

20.44

123

19.74

124

LocalPrior

16.66

125

GlobalPrior

16.62

126

muc_ai

9.47

127

CNN

1.74