Visual Question Answering (VQA) on VQA-CE

Metric: Accuracy (Counterexamples) (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Sort:

#	Model↕	Accuracy (Counterexamples)▼	Extra Data	Paper	Date↕	Code
1	RandImg	34.41	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code
2	LMH + CSS	34.36	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code
3	LFF	34.27	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code
4	LMH	34.26	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code
5	UpDown	33.91	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code
6	ESR	33.26	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code
7	LMH + RMFE	33.14	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code
8	BLOCK	32.91	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code
9	RUBi	32.25	No	Beyond Question-Based Biases: Assessing Multimod...	2021-04-07	Code

#1RandImgSOTA
34.41
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code
#2LMH + CSS
34.36
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code
#3LFF
34.27
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code
#4LMH
34.26
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code
#5UpDown
33.91
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code
#6ESR
33.26
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code
#7LMH + RMFE
33.14
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code
#8BLOCK
32.91
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code
#9RUBi
32.25
Accuracy (Counterexamples)· 2021-04-07
Beyond Question-Based Biases: Assessing Multimodal Shortcut Learning in Visual Question Answering Code