Meme Classification on Hateful Memes

Metric: ROC-AUC (higher is better)

LeaderboardDataset

Loading chart...

Results

Submit a result

Hide extra data

#	Model↕	ROC-AUC▼	Extra Data	Paper	Date↕	Code
1	RA-HMD (Qwen2-VL-7B)	0.911	No	Robust Adaptation of Large Multimodal Models for...	2025-02-18	Code
2	RA-HMD (LLaVA-1.5-7B)	0.897	No	Robust Adaptation of Large Multimodal Models for...	2025-02-18	Code
3	PaLI-X-VPD	0.892	No	Visual Program Distillation: Distilling Tools an...	2023-12-05	-
4	RA-HMD (Qwen2-VL-2B)	0.884	No	Robust Adaptation of Large Multimodal Models for...	2025-02-18	Code
5	RGCL (CLIP)	0.87	No	Improving Hateful Meme Detection through Retriev...	2023-11-14	Code
6	Flamingo (fine-tuned)	0.866	No	Flamingo: a Visual Language Model for Few-Shot L...	2022-04-29	Code
7	Hate-CLIPper - Align	0.858	No	Hate-CLIPper: Multimodal Hateful Meme Classifica...	2022-10-12	Code
8	ISSUES	0.855	No	Mapping Memes to Words for Multimodal Hateful Me...	2023-10-12	Code
9	Ron Zhu	0.845	Yes	Enhance Multimodal Transformer With External Lab...	2020-12-15	Code
10	Human	0.8265	No	The Hateful Memes Challenge: Detecting Hate Spee...	2020-05-10	Code
11	Vilio	0.825	No	Vilio: State-of-the-art Visio-Linguistic Models ...	2020-12-14	Code
12	HateDetectron27	0.811	Yes	Detecting Hate Speech in Memes Using Multimodal ...	2020-12-23	Code
13	Pro-Cap	0.809	No	Pro-Cap: Leveraging a Frozen Vision-Language Mod...	2023-08-16	Code
14	Visual BERT COCO	0.754	No	The Hateful Memes Challenge: Detecting Hate Spee...	2020-05-10	Code
15	SEER (RegNet10B)	0.734	Yes	Vision Models Are More Robust And Fair When Pret...	2022-02-16	Code
16	Flamingo (few-shot:32)	0.7	No	Flamingo: a Visual Language Model for Few-Shot L...	2022-04-29	Code
17	CLIP (zero-shot)	0.661	No	Learning Transferable Visual Models From Natural...	2021-02-26	Code