Meme Classification on Hateful Memes

Metric: ROC-AUC (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	ROC-AUC▼	Extra Data	Paper	Date↕	Code
1	RA-HMD (Qwen2-VL-7B)	0.911	No	Robust Adaptation of Large Multimodal Models for...	2025-02-18	Code
2	RA-HMD (LLaVA-1.5-7B)	0.897	No	Robust Adaptation of Large Multimodal Models for...	2025-02-18	Code
3	PaLI-X-VPD	0.892	No	Visual Program Distillation: Distilling Tools an...	2023-12-05	-
4	RA-HMD (Qwen2-VL-2B)	0.884	No	Robust Adaptation of Large Multimodal Models for...	2025-02-18	Code
5	RGCL (CLIP)	0.87	No	Improving Hateful Meme Detection through Retriev...	2023-11-14	Code
6	Flamingo (fine-tuned)	0.866	No	Flamingo: a Visual Language Model for Few-Shot L...	2022-04-29	Code
7	Hate-CLIPper - Align	0.858	No	Hate-CLIPper: Multimodal Hateful Meme Classifica...	2022-10-12	Code
8	ISSUES	0.855	No	Mapping Memes to Words for Multimodal Hateful Me...	2023-10-12	Code
9	Ron Zhu	0.845	Yes	Enhance Multimodal Transformer With External Lab...	2020-12-15	Code
10	Human	0.8265	No	The Hateful Memes Challenge: Detecting Hate Spee...	2020-05-10	Code
11	Vilio	0.825	No	Vilio: State-of-the-art Visio-Linguistic Models ...	2020-12-14	Code
12	HateDetectron27	0.811	Yes	Detecting Hate Speech in Memes Using Multimodal ...	2020-12-23	Code
13	Pro-Cap	0.809	No	Pro-Cap: Leveraging a Frozen Vision-Language Mod...	2023-08-16	Code
14	Visual BERT COCO	0.754	No	The Hateful Memes Challenge: Detecting Hate Spee...	2020-05-10	Code
15	SEER (RegNet10B)	0.734	Yes	Vision Models Are More Robust And Fair When Pret...	2022-02-16	Code
16	Flamingo (few-shot:32)	0.7	No	Flamingo: a Visual Language Model for Few-Shot L...	2022-04-29	Code
17	CLIP (zero-shot)	0.661	No	Learning Transferable Visual Models From Natural...	2021-02-26	Code

#1RA-HMD (Qwen2-VL-7B)SOTA
0.911
ROC-AUC· 2025-02-18
Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detection Code
#2RA-HMD (LLaVA-1.5-7B)
0.897
ROC-AUC· 2025-02-18
Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detection Code
#3PaLI-X-VPDSOTA
0.892
ROC-AUC· 2023-12-05
Visual Program Distillation: Distilling Tools and Programmatic Reasoning into Vision-Language Models
#4RA-HMD (Qwen2-VL-2B)
0.884
ROC-AUC· 2025-02-18
Robust Adaptation of Large Multimodal Models for Retrieval Augmented Hateful Meme Detection Code
#5RGCL (CLIP)SOTA
0.87
ROC-AUC· 2023-11-14
Improving Hateful Meme Detection through Retrieval-Guided Contrastive Learning Code
#6Flamingo (fine-tuned)SOTA
0.866
ROC-AUC· 2022-04-29
Flamingo: a Visual Language Model for Few-Shot Learning Code
#7Hate-CLIPper - Align
0.858
ROC-AUC· 2022-10-12
Hate-CLIPper: Multimodal Hateful Meme Classification based on Cross-modal Interaction of CLIP Features Code
#8ISSUES
0.855
ROC-AUC· 2023-10-12
Mapping Memes to Words for Multimodal Hateful Meme Classification Code
#9Ron ZhuSOTA
0.845
ROC-AUC· Extra Data· 2020-12-15
Enhance Multimodal Transformer With External Label And In-Domain Pretrain: Hateful Meme Challenge Winning Solution Code
#10HumanSOTA
0.8265
ROC-AUC· 2020-05-10
The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes Code
#11Vilio
0.825
ROC-AUC· 2020-12-14
Vilio: State-of-the-art Visio-Linguistic Models applied to Hateful Memes Code
#12HateDetectron27
0.811
ROC-AUC· Extra Data· 2020-12-23
Detecting Hate Speech in Memes Using Multimodal Deep Learning Approaches: Prize-winning solution to Hateful Memes Challenge Code
#13Pro-Cap
0.809
ROC-AUC· 2023-08-16
Pro-Cap: Leveraging a Frozen Vision-Language Model for Hateful Meme Detection Code
#14Visual BERT COCO
0.754
ROC-AUC· 2020-05-10
The Hateful Memes Challenge: Detecting Hate Speech in Multimodal Memes Code
#15SEER (RegNet10B)
0.734
ROC-AUC· Extra Data· 2022-02-16
Vision Models Are More Robust And Fair When Pretrained On Uncurated Images Without Supervision Code
#16Flamingo (few-shot:32)
0.7
ROC-AUC· 2022-04-29
Flamingo: a Visual Language Model for Few-Shot Learning Code
#17CLIP (zero-shot)
0.661
ROC-AUC· 2021-02-26
Learning Transferable Visual Models From Natural Language Supervision Code