Out-of-Distribution Detection on ImageNet-1k vs Curated OODs (avg.)

Metric: AUROC (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	AUROC▼	Extra Data	Paper	Date↕	Code
1	SCALE (ResNet50)	95.71	No	Scaling for Training Time and Post-hoc Out-of-di...	2023-09-30	Code
2	NNGuide (ResNet50 w/ ReAct)	95.45	No	Nearest Neighbor Guidance for Out-of-Distributio...	2023-09-26	Code
3	NNGuide (RegNet)	95.42	No	Nearest Neighbor Guidance for Out-of-Distributio...	2023-09-26	Code
4	ASH-S (ResNet-50)	95.12	No	Extremely Simple Activation Shaping for Out-of-D...	2022-09-20	Code
5	LINe (ResNet-50)	95.03	No	LINe: Out-of-Distribution Detection by Leveragin...	2023-03-24	Code
6	BATS (ResNet-50)	94.28	No	Boosting Out-of-distribution Detection with Typi...	2022-10-09	-
7	DICE + ReAct (ResNet-50)	93.4	No	DICE: Leveraging Sparsification for Out-of-Distr...	2021-11-18	Code
8	RankFeat (ResNetv2-101)	92.15	No	RankFeat: Rank-1 Feature Removal for Out-of-dist...	2022-09-18	Code
9	MCM (CLIP-L)	91.49	No	Delving into Out-of-Distribution Detection with ...	2022-11-24	Code
10	NPOS	91.22	No	Non-Parametric Outlier Synthesis	2023-03-06	Code
11	MOS (BiT-S-R101x1)	90.11	No	MOS: Towards Scaling Out-of-distribution Detecti...	2021-05-05	Code
12	ODIN+UMAP (ResNet-50)	89.24	No	Unleashing Mask: Explore the Intrinsic Out-of-Di...	2023-06-06	Code
13	MOOD	89.1	No	Rethinking Out-of-distribution (OOD) Detection: ...	2023-02-06	Code
14	DOE	83.54	No	Out-of-distribution Detection with Implicit Outl...	2023-03-09	Code

#1SCALE (ResNet50)SOTA
95.71
AUROC· 2023-09-30
Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement Code
#2NNGuide (ResNet50 w/ ReAct)SOTA
95.45
AUROC· 2023-09-26
Nearest Neighbor Guidance for Out-of-Distribution Detection Code
#3NNGuide (RegNet)
95.42
AUROC· 2023-09-26
Nearest Neighbor Guidance for Out-of-Distribution Detection Code
#4ASH-S (ResNet-50)SOTA
95.12
AUROC· 2022-09-20
Extremely Simple Activation Shaping for Out-of-Distribution Detection Code
#5LINe (ResNet-50)
95.03
AUROC· 2023-03-24
LINe: Out-of-Distribution Detection by Leveraging Important Neurons Code
#6BATS (ResNet-50)
94.28
AUROC· 2022-10-09
Boosting Out-of-distribution Detection with Typical Features
#7DICE + ReAct (ResNet-50)SOTA
93.4
AUROC· 2021-11-18
DICE: Leveraging Sparsification for Out-of-Distribution Detection Code
#8RankFeat (ResNetv2-101)
92.15
AUROC· 2022-09-18
RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection Code
#9MCM (CLIP-L)
91.49
AUROC· 2022-11-24
Delving into Out-of-Distribution Detection with Vision-Language Representations Code
#10NPOS
91.22
AUROC· 2023-03-06
Non-Parametric Outlier Synthesis Code
#11MOS (BiT-S-R101x1)SOTA
90.11
AUROC· 2021-05-05
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space Code
#12ODIN+UMAP (ResNet-50)
89.24
AUROC· 2023-06-06
Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability Code
#13MOOD
89.1
AUROC· 2023-02-06
Rethinking Out-of-distribution (OOD) Detection: Masked Image Modeling is All You Need Code
#14DOE
83.54
AUROC· 2023-03-09
Out-of-distribution Detection with Implicit Outlier Transformation Code