Visual Question Answering (VQA) on GQA Test2019

Metric: Distribution (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Distribution▼	Extra Data	Paper	Date↕	Code
1	GlobalPrior	93.08	No	-	-	-
2	Mycsulb	40.84	No	-	-	-
3	Academia Sinica	40.44	No	-	-	-
4	Fj	28.4	No	-	-	-
5	CNN	19.99	No	-	-	-
6	LAS	19.05	No	-	-	-
7	LSTM	17.93	No	-	-	-
8	RES	17.79	No	-	-	-
9	RAM_BUGGY	14.28	No	-	-	-
10	LocalPrior	13.98	No	-	-	-
11	mfb+bert	13.72	No	-	-	-
12	MReaL	13.01	No	-	-	-
13	UJCNN	12.54	No	-	-	-
14	muc_ai	11.49	No	-	-	-
15	bear	10.99	No	-	-	-
16	BAN	10.52	No	-	-	-
17	RSN (Single Model)_v6	10.18	No	-	-	-
18	Musan	10.1	No	-	-	-
19	LW	9.69	No	-	-	-
20	wcf-fight	9.5	No	-	-	-
21	5TMT-qe+o	8.66	No	-	-	-
22	Ensemble10	8.56	No	-	-	-
23	prompt IMT-16	8.48	No	-	-	-
24	113	8.38	No	-	-	-
25	Ediburgh-Mila-UCLA	8.35	No	-	-	-
26	Partial-MSP	7.86	No	-	-	-
27	CHAIR	7.63	No	-	-	-
28	happyTeam	7.6	No	-	-	-
29	LSTM+CNN	7.46	No	-	-	-
30	LININ	7.28	No	-	-	-
31	GM6_9_2_train	7.13	No	-	-	-
32	gbert1	6.93	No	-	-	-
33	sparsemax15	6.91	No	-	-	-
34	GRN	6.77	No	Bilinear Graph Networks for Visual Question Answ...	2019-07-23	-
35	Mithrandir	6.77	No	-	-	-
36	ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json	6.58	No	-	-	-
37	Space Cat	6.45	No	-	-	-
38	bert_v1	6.43	No	-	-	-
39	LXR955, Ensemble	6.42	No	LXMERT: Learning Cross-Modality Encoder Represen...	2019-08-20	Code
40	fbe20v3.json	6.41	No	-	-	-
41	Sorbonne	6.4	No	-	-	-
42	mcmi	6.39	No	-	-	-
43	Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep	6.32	No	-	-	-
44	test	6.29	No	-	-	-
45	SSRP	6.28	No	-	-	-
46	DAM	6.25	No	-	-	-
47	Inspur	6.21	No	-	-	-
48	happy	6.16	No	-	-	-
49	QGCRGN	6.14	No	-	-	-
50	xpj	6.09	No	-	-	-
51	Testify	6.07	No	-	-	-
52	gaochongyang9	6.06	No	-	-	-
53	rishabh_test	6.06	No	-	-	-
54	RSN (Single Model)	6.06	No	-	-	-
55	RD	6.05	No	-	-	-
56	vv69	6.03	No	-	-	-
57	ST_VQA	6.02	No	-	-	-
58	DL16	6.01	No	-	-	-
59	HDU_ZWF	6.01	No	-	-	-
60	PVR	6	No	-	-	-
61	BottomUp	5.98	No	Bottom-Up and Top-Down Attention for Image Capti...	2017-07-25	Code
62	rsa-14word	5.94	No	-	-	-
63	GIN	5.87	No	-	-	-
64	ZhaoLab	5.84	No	-	-	-
65	Future_Test_team	5.83	No	-	-	-
66	tmp	5.81	No	-	-	-
67	UCAS-SARI	5.81	No	-	-	-
68	total14	5.81	No	-	-	-
69	UNITER + MAC + Graph Networks	5.8	No	-	-	-
70	MMT-VQA	5.78	No	-	-	-
71	45	5.74	No	-	-	-
72	graphRepresentation， Single	5.73	No	-	-	-
73	UCM	5.7	No	-	-	-
74	LXR955, Single Model	5.69	No	LXMERT: Learning Cross-Modality Encoder Represen...	2019-08-20	Code
75	MJ	5.69	No	-	-	-
76	MSM@MSRA	5.68	No	-	-	-
77	test gqa	5.65	No	-	-	-
78	stu09e	5.65	No	-	-	-
79	VqaStar-UCAS-SARI	5.65	No	-	-	-
80	mac_qin	5.64	No	-	-	-
81	full_nsp_mlm_ft_joint_results_submit_predict.json	5.63	No	-	-	-
82	LXMERT-S	5.6	No	-	-	-
83	result_run_2647872_epoch11	5.6	No	-	-	-
84	lxmert-adv-txt	5.55	No	-	-	-
85	Meta Module, Single	5.54	No	-	-	-
86	glimple_all	5.54	No	-	-	-
87	lxmert-adv-txt	5.52	No	-	-	-
88	MLVQA (single)	5.48	No	-	-	-
89	nogg	5.48	No	-	-	-
90	IWantADonut	5.42	No	-	-	-
91	LOGNet+VLR	5.42	No	-	-	-
92	vips	5.41	No	-	-	-
93	full_nsp_ft_results_submit_predict.json	5.39	No	-	-	-
94	IIE_Morningstar	5.38	No	-	-	-
95	MDETR	5.36	No	-	-	-
96	fisher	5.36	No	-	-	-
97	REX	5.36	No	-	-	-
98	MAC	5.34	No	-	-	-
99	1-gqa	5.33	No	-	-	-
100	Deepblue_Semantics	5.32	No	-	-	-
101	test	5.32	No	-	-	-
102	IQA (single)	5.31	No	-	-	-
103	TESTOVQA007	5.29	No	-	-	-
104	DeeTee	5.29	No	-	-	-
105	KU	5.29	No	-	-	-
106	Single	5.25	No	-	-	-
107	mlmbert	5.24	No	-	-	-
108	abc_test	5.22	No	-	-	-
109	Improved SNMN	5.14	No	-	-	-
110	VinVL-DPT	5.11	No	-	-	-
111	BgTest	5.11	No	-	-	-
112	Eden_test	5.1	No	-	-	-
113	ckpt 19 exp 90	4.86	No	-	-	-
114	Single Model	4.72	No	VinVL: Revisiting Visual Representations in Visi...	2021-01-02	Code
115	LCGN	4.7	No	-	-	-
116	Wayne	4.69	No	-	-	-
117	F205	4.68	No	-	-	-
118	VinVL+L	4.59	No	-	-	Code
119	NSM single (updated)	3.71	No	-	-	-
120	DREAM+Unicoder-VL (MSRA)	3.68	No	-	-	-
121	NSM ensemble (updated)	2.78	No	-	-	-
122	Kakao Brain	2.46	No	-	-	-
123	Coarse-to-Fine Reasoning, Single Model	2.39	No	-	-	-
124	MIL-nbgao	1.7	No	-	-	-
125	270	1.49	No	-	-	-
126	TRRNet (Ensemble)	1.29	No	-	-	-
127	human	0	No	-	-	-

#1GlobalPrior
93.08
Distribution
No paper
#2Mycsulb
40.84
Distribution
No paper
#3Academia Sinica
40.44
Distribution
No paper
#4Fj
28.4
Distribution
No paper
#5CNN
19.99
Distribution
No paper
#6LAS
19.05
Distribution
No paper
#7LSTM
17.93
Distribution
No paper
#8RES
17.79
Distribution
No paper
#9RAM_BUGGY
14.28
Distribution
No paper
#10LocalPrior
13.98
Distribution
No paper
#11mfb+bert
13.72
Distribution
No paper
#12MReaL
13.01
Distribution
No paper
#13UJCNN
12.54
Distribution
No paper
#14muc_ai
11.49
Distribution
No paper
#15bear
10.99
Distribution
No paper
#16BAN
10.52
Distribution
No paper
#17RSN (Single Model)_v6
10.18
Distribution
No paper
#18Musan
10.1
Distribution
No paper
#19LW
9.69
Distribution
No paper
#20wcf-fight
9.5
Distribution
No paper
#215TMT-qe+o
8.66
Distribution
No paper
#22Ensemble10
8.56
Distribution
No paper
#23prompt IMT-16
8.48
Distribution
No paper
#24113
8.38
Distribution
No paper
#25Ediburgh-Mila-UCLA
8.35
Distribution
No paper
#26Partial-MSP
7.86
Distribution
No paper
#27CHAIR
7.63
Distribution
No paper
#28happyTeam
7.6
Distribution
No paper
#29LSTM+CNN
7.46
Distribution
No paper
#30LININ
7.28
Distribution
No paper
#31GM6_9_2_train
7.13
Distribution
No paper
#32gbert1
6.93
Distribution
No paper
#33sparsemax15
6.91
Distribution
No paper
#34GRNSOTA
6.77
Distribution· 2019-07-23
Bilinear Graph Networks for Visual Question Answering
#35Mithrandir
6.77
Distribution
No paper
#36ours-4-gqa_el_tag_v4__pretrain_rel_tag_dist_tc_v7_checkpoint-47-157510-best-4.json
6.58
Distribution
No paper
#37Space Cat
6.45
Distribution
No paper
#38bert_v1
6.43
Distribution
No paper
#39LXR955, Ensemble
6.42
Distribution· 2019-08-20
LXMERT: Learning Cross-Modality Encoder Representations from Transformers Code
#40fbe20v3.json
6.41
Distribution
No paper
#41Sorbonne
6.4
Distribution
No paper
#42mcmi
6.39
Distribution
No paper
#43Feb_ft2_mergeadd_weightalllstm_picklocw_box5_prep
6.32
Distribution
No paper
#44test
6.29
Distribution
No paper
#45SSRP
6.28
Distribution
No paper
#46DAM
6.25
Distribution
No paper
#47Inspur
6.21
Distribution
No paper
#48happy
6.16
Distribution
No paper
#49QGCRGN
6.14
Distribution
No paper
#50xpj
6.09
Distribution
No paper
#51Testify
6.07
Distribution
No paper
#52gaochongyang9
6.06
Distribution
No paper
#53rishabh_test
6.06
Distribution
No paper
#54RSN (Single Model)
6.06
Distribution
No paper
#55RD
6.05
Distribution
No paper
#56vv69
6.03
Distribution
No paper
#57ST_VQA
6.02
Distribution
No paper
#58DL16
6.01
Distribution
No paper
#59HDU_ZWF
6.01
Distribution
No paper
#60PVR
6
Distribution
No paper
#61BottomUpSOTA
5.98
Distribution· 2017-07-25
Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answering Code
#62rsa-14word
5.94
Distribution
No paper
#63GIN
5.87
Distribution
No paper
#64ZhaoLab
5.84
Distribution
No paper
#65Future_Test_team
5.83
Distribution
No paper
#66tmp
5.81
Distribution
No paper
#67UCAS-SARI
5.81
Distribution
No paper
#68total14
5.81
Distribution
No paper
#69UNITER + MAC + Graph Networks
5.8
Distribution
No paper
#70MMT-VQA
5.78
Distribution
No paper
#7145
5.74
Distribution
No paper
#72graphRepresentation， Single
5.73
Distribution
No paper
#73UCM
5.7
Distribution
No paper
#74LXR955, Single Model
5.69
Distribution· 2019-08-20
LXMERT: Learning Cross-Modality Encoder Representations from Transformers Code
#75MJ
5.69
Distribution
No paper
#76MSM@MSRA
5.68
Distribution
No paper
#77test gqa
5.65
Distribution
No paper
#78stu09e
5.65
Distribution
No paper
#79VqaStar-UCAS-SARI
5.65
Distribution
No paper
#80mac_qin
5.64
Distribution
No paper
#81full_nsp_mlm_ft_joint_results_submit_predict.json
5.63
Distribution
No paper
#82LXMERT-S
5.6
Distribution
No paper
#83result_run_2647872_epoch11
5.6
Distribution
No paper
#84lxmert-adv-txt
5.55
Distribution
No paper
#85Meta Module, Single
5.54
Distribution
No paper
#86glimple_all
5.54
Distribution
No paper
#87lxmert-adv-txt
5.52
Distribution
No paper
#88MLVQA (single)
5.48
Distribution
No paper
#89nogg
5.48
Distribution
No paper
#90IWantADonut
5.42
Distribution
No paper
#91LOGNet+VLR
5.42
Distribution
No paper
#92vips
5.41
Distribution
No paper
#93full_nsp_ft_results_submit_predict.json
5.39
Distribution
No paper
#94IIE_Morningstar
5.38
Distribution
No paper
#95MDETR
5.36
Distribution
No paper
#96fisher
5.36
Distribution
No paper
#97REX
5.36
Distribution
No paper
#98MAC
5.34
Distribution
No paper
#991-gqa
5.33
Distribution
No paper
#100Deepblue_Semantics
5.32
Distribution
No paper
#101test
5.32
Distribution
No paper
#102IQA (single)
5.31
Distribution
No paper
#103TESTOVQA007
5.29
Distribution
No paper
#104DeeTee
5.29
Distribution
No paper
#105KU
5.29
Distribution
No paper
#106Single
5.25
Distribution
No paper
#107mlmbert
5.24
Distribution
No paper
#108abc_test
5.22
Distribution
No paper
#109Improved SNMN
5.14
Distribution
No paper
#110VinVL-DPT
5.11
Distribution
No paper
#111BgTest
5.11
Distribution
No paper
#112Eden_test
5.1
Distribution
No paper
#113ckpt 19 exp 90
4.86
Distribution
No paper
#114Single Model
4.72
Distribution· 2021-01-02
VinVL: Revisiting Visual Representations in Vision-Language Models Code
#115LCGN
4.7
Distribution
No paper
#116Wayne
4.69
Distribution
No paper
#117F205
4.68
Distribution
No paper
#118VinVL+L
4.59
Distribution
No paperCode
#119NSM single (updated)
3.71
Distribution
No paper
#120DREAM+Unicoder-VL (MSRA)
3.68
Distribution
No paper
#121NSM ensemble (updated)
2.78
Distribution
No paper
#122Kakao Brain
2.46
Distribution
No paper
#123Coarse-to-Fine Reasoning, Single Model
2.39
Distribution
No paper
#124MIL-nbgao
1.7
Distribution
No paper
#125270
1.49
Distribution
No paper
#126TRRNet (Ensemble)
1.29
Distribution
No paper
#127human
0
Distribution
No paper