Visual Question Answering (VQA) on GQA Test2019

Metric: Open (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Open▼	Extra Data	Paper	Date↕	Code
1	human	87.4	No	-	-	-
2	DREAM+Unicoder-VL (MSRA)	68.6	No	-	-	-
3	Kakao Brain	67.73	No	-	-	-
4	MIL-nbgao	67.64	No	-	-	-
5	TRRNet (Ensemble)	66.89	No	-	-	-
6	Coarse-to-Fine Reasoning, Single Model	64.19	No	-	-	-
7	270	63.82	No	-	-	-
8	NSM ensemble (updated)	56.16	No	-	-	-
9	Single	50.22	No	-	-	-
10	VinVL-DPT	49.29	No	-	-	-
11	NSM single (updated)	49.25	No	-	-	-
12	VinVL+L	49.19	No	-	-	Code
13	Wayne	49.03	No	-	-	-
14	Single Model	48.77	No	VinVL: Revisiting Visual Representations in Visi...	2021-01-02	Code
15	LXR955, Ensemble	47.64	No	LXMERT: Learning Cross-Modality Encoder Represen...	2019-08-20	Code
16	1-gqa	46.69	No	-	-	-
17	UCM	46.56	No	-	-	-
18	fisher	46.55	No	-	-	-
19	MSM@MSRA	46.3	No	-	-	-
20	lxmert-adv-txt	46.19	No	-	-	-
21	lxmert-adv-txt	46.16	No	-	-	-
22	MDETR	46.15	No	-	-	-
23	mlmbert	46.06	No	-	-	-
24	prompt IMT-16	46.06	No	-	-	-
25	45	46.01	No	-	-	-
26	xpj	45.96	No	-	-	-
27	GRN	45.81	No	Bilinear Graph Networks for Visual Question Answ...	2019-07-23	-
28	IQA (single)	45.73	No	-	-	-
29	vv69	45.68	No	-	-	-
30	bert_v1	45.61	No	-	-	-
31	full_nsp_mlm_ft_joint_results_submit_predict.json	45.59	No	-	-	-
32	ckpt 19 exp 90	45.54	No	-	-	-
33	full_nsp_ft_results_submit_predict.json	45.51	No	-	-	-
34	test gqa	45.48	No	-	-	-
35	LXR955, Single Model	45.47	No	LXMERT: Learning Cross-Modality Encoder Represen...	2019-08-20	Code
36	IIE_Morningstar	45.41	No	-	-	-
37	fbe20v3.json	45.36	No	-	-	-
38	TESTOVQA007	45.36	No	-	-	-
39	Inspur	45.27	No	-	-	-
40	SSRP	45.21	No	-	-	-
41	Future_Test_team	45.14	No	-	-	-
42	tmp	45.12	No	-	-	-
43	Meta Module, Single	44.89	No	-	-	-
44	gaochongyang9	44.89	No	-	-	-
45	BgTest	44.85	No	-	-	-
46	LININ	44.83	No	-	-	-
47	Ensemble10	44.76	No	-	-	-
48	glimple_all	44.58	No	-	-	-
49	QGCRGN	44.04	No	-	-	-
50	mcmi	43.82	No	-	-	-
51	PVR	43.75	No	-	-	-
52	gbert1	43.75	No	-	-	-
53	DAM	43.61	No	-	-	-
54	LXMERT-S	43.6	No	-	-	-
55	UNITER + MAC + Graph Networks	43.38	No	-	-	-
56	rishabh_test	43.35	No	-	-	-
57	DL16	43.26	No	-	-	-
58	graphRepresentation， Single	43.19	No	-	-	-
59	ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json	43.11	No	-	-	-
60	Musan	43.02	No	-	-	-
61	UCAS-SARI	42.57	No	-	-	-
62	LCGN	42.33	No	-	-	-
63	VqaStar-UCAS-SARI	42.26	No	-	-	-
64	MLVQA (single)	42.14	No	-	-	-
65	F205	42.11	No	-	-	-
66	stu09e	42	No	-	-	-
67	result_run_2647872_epoch11	41.99	No	-	-	-
68	RD	41.93	No	-	-	-
69	REX	41.86	No	-	-	-
70	rsa-14word	41.71	No	-	-	-
71	happyTeam	41.7	No	-	-	-
72	Partial-MSP	41.67	No	-	-	-
73	Testify	41.64	No	-	-	-
74	LOGNet+VLR	41.52	No	-	-	-
75	IWantADonut	41.47	No	-	-	-
76	total14	41.36	No	-	-	-
77	RSN (Single Model)	41.32	No	-	-	-
78	DeeTee	41.31	No	-	-	-
79	GM6_9_2_train	41.06	No	-	-	-
80	wcf-fight	41.02	No	-	-	-
81	ZhaoLab	40.97	No	-	-	-
82	MMT-VQA	40.87	No	-	-	-
83	Improved SNMN	40.82	No	-	-	-
84	GIN	40.8	No	-	-	-
85	vips	40.79	No	-	-	-
86	RSN (Single Model)_v6	40.74	No	-	-	-
87	Deepblue_Semantics	40.53	No	-	-	-
88	LW	40.46	No	-	-	-
89	BAN	40.41	No	-	-	-
90	ST_VQA	40.2	No	-	-	-
91	Eden_test	40.14	No	-	-	-
92	Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep	40.09	No	-	-	-
93	abc_test	40.08	No	-	-	-
94	nogg	39.99	No	-	-	-
95	KU	39.92	No	-	-	-
96	HDU_ZWF	39.23	No	-	-	-
97	test	38.94	No	-	-	-
98	MAC	38.91	No	-	-	-
99	mac_qin	38.5	No	-	-	-
100	Sorbonne	38.23	No	-	-	-
101	UJCNN	38.04	No	-	-	-
102	Mithrandir	37.64	No	-	-	-
103	5TMT-qe+o	37.44	No	-	-	-
104	test	37.34	No	-	-	-
105	MJ	37.22	No	-	-	-
106	happy	37.11	No	-	-	-
107	mfb+bert	35.83	No	-	-	-
108	Space Cat	35.2	No	-	-	-
109	BottomUp	34.83	No	Bottom-Up and Top-Down Attention for Image Capti...	2017-07-25	Code
110	sparsemax15	34	No	-	-	-
111	RES	33.81	No	-	-	-
112	RAM_BUGGY	33.12	No	-	-	-
113	Ediburgh-Mila-UCLA	32.13	No	-	-	-
114	LSTM+CNN	31.8	No	-	-	-
115	LAS	31.34	No	-	-	-
116	bear	30.24	No	-	-	-
117	MReaL	29.73	No	-	-	-
118	113	29.2	No	-	-	-
119	CHAIR	26.45	No	-	-	-
120	LSTM	22.69	No	-	-	-
121	Academia Sinica	21.88	No	-	-	-
122	Mycsulb	20.44	No	-	-	-
123	Fj	19.74	No	-	-	-
124	LocalPrior	16.66	No	-	-	-
125	GlobalPrior	16.62	No	-	-	-
126	muc_ai	9.47	No	-	-	-
127	CNN	1.74	No	-	-	-

#1human
87.4
Open
No paper
#2DREAM+Unicoder-VL (MSRA)
68.6
Open
No paper
#3Kakao Brain
67.73
Open
No paper
#4MIL-nbgao
67.64
Open
No paper
#5TRRNet (Ensemble)
66.89
Open
No paper
#6Coarse-to-Fine Reasoning, Single Model
64.19
Open
No paper
#7270
63.82
Open
No paper
#8NSM ensemble (updated)
56.16
Open
No paper
#9Single
50.22
Open
No paper
#10VinVL-DPT
49.29
Open
No paper
#11NSM single (updated)
49.25
Open
No paper
#12VinVL+L
49.19
Open
No paperCode
#13Wayne
49.03
Open
No paper
#14Single ModelSOTA
48.77
Open· 2021-01-02
VinVL: Revisiting Visual Representations in Vision-Language Models Code
#15LXR955, EnsembleSOTA
47.64
Open· 2019-08-20
LXMERT: Learning Cross-Modality Encoder Representations from Transformers Code
#161-gqa
46.69
Open
No paper
#17UCM
46.56
Open
No paper
#18fisher
46.55
Open
No paper
#19MSM@MSRA
46.3
Open
No paper
#20lxmert-adv-txt
46.19
Open
No paper
#21lxmert-adv-txt
46.16
Open
No paper
#22MDETR
46.15
Open
No paper
#23mlmbert
46.06
Open
No paper
#24prompt IMT-16
46.06
Open
No paper
#2545
46.01
Open
No paper
#26xpj
45.96
Open
No paper
#27GRNSOTA
45.81
Open· 2019-07-23
Bilinear Graph Networks for Visual Question Answering
#28IQA (single)
45.73
Open
No paper
#29vv69
45.68
Open
No paper
#30bert_v1
45.61
Open
No paper
#31full_nsp_mlm_ft_joint_results_submit_predict.json
45.59
Open
No paper
#32ckpt 19 exp 90
45.54
Open
No paper
#33full_nsp_ft_results_submit_predict.json
45.51
Open
No paper
#34test gqa
45.48
Open
No paper
#35LXR955, Single Model
45.47
Open· 2019-08-20
LXMERT: Learning Cross-Modality Encoder Representations from Transformers Code
#36IIE_Morningstar
45.41
Open
No paper
#37fbe20v3.json
45.36
Open
No paper
#38TESTOVQA007
45.36
Open
No paper
#39Inspur
45.27
Open
No paper
#40SSRP
45.21
Open
No paper
#41Future_Test_team
45.14
Open
No paper
#42tmp
45.12
Open
No paper
#43Meta Module, Single
44.89
Open
No paper
#44gaochongyang9
44.89
Open
No paper
#45BgTest
44.85
Open
No paper
#46LININ
44.83
Open
No paper
#47Ensemble10
44.76
Open
No paper
#48glimple_all
44.58
Open
No paper
#49QGCRGN
44.04
Open
No paper
#50mcmi
43.82
Open
No paper
#51PVR
43.75
Open
No paper
#52gbert1
43.75
Open
No paper
#53DAM
43.61
Open
No paper
#54LXMERT-S
43.6
Open
No paper
#55UNITER + MAC + Graph Networks
43.38
Open
No paper
#56rishabh_test
43.35
Open
No paper
#57DL16
43.26
Open
No paper
#58graphRepresentation， Single
43.19
Open
No paper
#59ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json
43.11
Open
No paper
#60Musan
43.02
Open
No paper
#61UCAS-SARI
42.57
Open
No paper
#62LCGN
42.33
Open
No paper
#63VqaStar-UCAS-SARI
42.26
Open
No paper
#64MLVQA (single)
42.14
Open
No paper
#65F205
42.11
Open
No paper
#66stu09e
42
Open
No paper
#67result_run_2647872_epoch11
41.99
Open
No paper
#68RD
41.93
Open
No paper
#69REX
41.86
Open
No paper
#70rsa-14word
41.71
Open
No paper
#71happyTeam
41.7
Open
No paper
#72Partial-MSP
41.67
Open
No paper
#73Testify
41.64
Open
No paper
#74LOGNet+VLR
41.52
Open
No paper
#75IWantADonut
41.47
Open
No paper
#76total14
41.36
Open
No paper
#77RSN (Single Model)
41.32
Open
No paper
#78DeeTee
41.31
Open
No paper
#79GM6_9_2_train
41.06
Open
No paper
#80wcf-fight
41.02
Open
No paper
#81ZhaoLab
40.97
Open
No paper
#82MMT-VQA
40.87
Open
No paper
#83Improved SNMN
40.82
Open
No paper
#84GIN
40.8
Open
No paper
#85vips
40.79
Open
No paper
#86RSN (Single Model)_v6
40.74
Open
No paper
#87Deepblue_Semantics
40.53
Open
No paper
#88LW
40.46
Open
No paper
#89BAN
40.41
Open
No paper
#90ST_VQA
40.2
Open
No paper
#91Eden_test
40.14
Open
No paper
#92Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep
40.09
Open
No paper
#93abc_test
40.08
Open
No paper
#94nogg
39.99
Open
No paper
#95KU
39.92
Open
No paper
#96HDU_ZWF
39.23
Open
No paper
#97test
38.94
Open
No paper
#98MAC
38.91
Open
No paper
#99mac_qin
38.5
Open
No paper
#100Sorbonne
38.23
Open
No paper
#101UJCNN
38.04
Open
No paper
#102Mithrandir
37.64
Open
No paper
#1035TMT-qe+o
37.44
Open
No paper
#104test
37.34
Open
No paper
#105MJ
37.22
Open
No paper
#106happy
37.11
Open
No paper
#107mfb+bert
35.83
Open
No paper
#108Space Cat
35.2
Open
No paper
#109BottomUpSOTA
34.83
Open· 2017-07-25
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering Code
#110sparsemax15
34
Open
No paper
#111RES
33.81
Open
No paper
#112RAM_BUGGY
33.12
Open
No paper
#113Ediburgh-Mila-UCLA
32.13
Open
No paper
#114LSTM+CNN
31.8
Open
No paper
#115LAS
31.34
Open
No paper
#116bear
30.24
Open
No paper
#117MReaL
29.73
Open
No paper
#118113
29.2
Open
No paper
#119CHAIR
26.45
Open
No paper
#120LSTM
22.69
Open
No paper
#121Academia Sinica
21.88
Open
No paper
#122Mycsulb
20.44
Open
No paper
#123Fj
19.74
Open
No paper
#124LocalPrior
16.66
Open
No paper
#125GlobalPrior
16.62
Open
No paper
#126muc_ai
9.47
Open
No paper
#127CNN
1.74
Open
No paper