Out-of-Distribution Detection on ImageNet-1k vs Curated OODs (avg.)

Metric: FPR95 (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	FPR95▼	Extra Data	Paper	Date↕	Code
1	RP+GradNorm	70.12	No	-	-	Code
2	DOE	59.83	No	Out-of-distribution Detection with Implicit Outl...	2023-03-09	Code
3	DML	54.74	No	-	-	-
4	ODIN+UMAP (ResNet-50)	40.94	No	Unleashing Mask: Explore the Intrinsic Out-of-Di...	2023-06-06	Code
5	MOS (BiT-S-R101x1)	39.97	No	MOS: Towards Scaling Out-of-distribution Detecti...	2021-05-05	Code
6	MCM (CLIP-L)	38.17	No	Delving into Out-of-Distribution Detection with ...	2022-11-24	Code
7	NPOS	37.93	No	Non-Parametric Outlier Synthesis	2023-03-06	Code
8	RankFeat (ResNetv2-101)	36.8	No	RankFeat: Rank-1 Feature Removal for Out-of-dist...	2022-09-18	Code
9	DICE + ReAct (ResNet-50)	27.25	No	DICE: Leveraging Sparsification for Out-of-Distr...	2021-11-18	Code
10	BATS (ResNet-50)	27.11	No	Boosting Out-of-distribution Detection with Typi...	2022-10-09	-
11	ASH-S (ResNet-50)	22.8	No	Extremely Simple Activation Shaping for Out-of-D...	2022-09-20	Code
12	LINe (ResNet-50)	20.7	No	LINe: Out-of-Distribution Detection by Leveragin...	2023-03-24	Code
13	SCALE (ResNet50)	20.05	No	Scaling for Training Time and Post-hoc Out-of-di...	2023-09-30	Code
14	NNGuide (ResNet50 w/ ReAct)	19.72	No	Nearest Neighbor Guidance for Out-of-Distributio...	2023-09-26	Code
15	NNGuide (RegNet)	17.97	No	Nearest Neighbor Guidance for Out-of-Distributio...	2023-09-26	Code

#1RP+GradNorm
70.12
FPR95
No paperCode
#2DOESOTA
59.83
FPR95· 2023-03-09
Out-of-distribution Detection with Implicit Outlier Transformation Code
#3DML
54.74
FPR95
No paper
#4ODIN+UMAP (ResNet-50)
40.94
FPR95· 2023-06-06
Unleashing Mask: Explore the Intrinsic Out-of-Distribution Detection Capability Code
#5MOS (BiT-S-R101x1)SOTA
39.97
FPR95· 2021-05-05
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space Code
#6MCM (CLIP-L)
38.17
FPR95· 2022-11-24
Delving into Out-of-Distribution Detection with Vision-Language Representations Code
#7NPOS
37.93
FPR95· 2023-03-06
Non-Parametric Outlier Synthesis Code
#8RankFeat (ResNetv2-101)
36.8
FPR95· 2022-09-18
RankFeat: Rank-1 Feature Removal for Out-of-distribution Detection Code
#9DICE + ReAct (ResNet-50)
27.25
FPR95· 2021-11-18
DICE: Leveraging Sparsification for Out-of-Distribution Detection Code
#10BATS (ResNet-50)
27.11
FPR95· 2022-10-09
Boosting Out-of-distribution Detection with Typical Features
#11ASH-S (ResNet-50)
22.8
FPR95· 2022-09-20
Extremely Simple Activation Shaping for Out-of-Distribution Detection Code
#12LINe (ResNet-50)
20.7
FPR95· 2023-03-24
LINe: Out-of-Distribution Detection by Leveraging Important Neurons Code
#13SCALE (ResNet50)
20.05
FPR95· 2023-09-30
Scaling for Training Time and Post-hoc Out-of-distribution Detection Enhancement Code
#14NNGuide (ResNet50 w/ ReAct)
19.72
FPR95· 2023-09-26
Nearest Neighbor Guidance for Out-of-Distribution Detection Code
#15NNGuide (RegNet)
17.97
FPR95· 2023-09-26
Nearest Neighbor Guidance for Out-of-Distribution Detection Code