Out-of-Distribution Detection on CIFAR-100 vs CIFAR-10

Metric: AUROC (higher is better)

LeaderboardDataset

Loading chart...

Results

Hide extra data

Sort:

#	Model↕	AUROC▼	Extra Data	Paper	Date↕	Code
1	DHM	100	No	-	-	-
2	Ensemble of ViTs	98.11	Yes	Exploring the Limits of Out-of-Distribution Dete...	2021-06-06	Code
3	ViT-L_16 finetuned on CIFAR-100	97.98	Yes	Exploring the Limits of Out-of-Distribution Dete...	2021-06-06	Code
4	R50+ViT_B-16 finetuned on CIFAR-100	96.23	Yes	Exploring the Limits of Out-of-Distribution Dete...	2021-06-06	Code
5	ViT_B-16 finetuned on CIFAR-100	95.53	Yes	Exploring the Limits of Out-of-Distribution Dete...	2021-06-06	Code
6	MLP-Mixer_B-16 finetuned on CIFAR-100	95.31	Yes	Exploring the Limits of Out-of-Distribution Dete...	2021-06-06	Code
7	CLIP using class name words describing the two distributions	94.68	Yes	Exploring the Limits of Out-of-Distribution Dete...	2021-06-06	Code
8	ERD (ResNet18)	94.3	Yes	Semi-supervised novelty detection using ensemble...	2020-12-10	Code
9	OpenHybrid	85.6	No	Hybrid Models for Open Set Recognition	2020-03-27	-
10	Maximum Logit Score (MLS)	83.2	No	Open-Set Recognition: a Good Closed-Set Classifi...	2021-10-12	Code
11	WRN 40-2 + OECC	78.7	Yes	Outlier Exposure with Confidence Control for Out...	2019-06-08	Code
12	Joint contrastive and supervised training	78.3	No	Contrastive Training for Improved Out-of-Distrib...	2020-07-10	-
13	ResNet + diagonal elements of Gram matrix	76.6	No	Detecting Out-of-Distribution Examples with In-d...	2019-12-28	Code
14	DenseNet + diagonal elements of Gram matrix	70.1	No	Detecting Out-of-Distribution Examples with In-d...	2019-12-28	Code

#1DHM
100
AUROC
No paper
#2Ensemble of ViTsSOTA
98.11
AUROC· Extra Data· 2021-06-06
Exploring the Limits of Out-of-Distribution Detection Code
#3ViT-L_16 finetuned on CIFAR-100
97.98
AUROC· Extra Data· 2021-06-06
Exploring the Limits of Out-of-Distribution Detection Code
#4R50+ViT_B-16 finetuned on CIFAR-100
96.23
AUROC· Extra Data· 2021-06-06
Exploring the Limits of Out-of-Distribution Detection Code
#5ViT_B-16 finetuned on CIFAR-100
95.53
AUROC· Extra Data· 2021-06-06
Exploring the Limits of Out-of-Distribution Detection Code
#6MLP-Mixer_B-16 finetuned on CIFAR-100
95.31
AUROC· Extra Data· 2021-06-06
Exploring the Limits of Out-of-Distribution Detection Code
#7CLIP using class name words describing the two distributions
94.68
AUROC· Extra Data· 2021-06-06
Exploring the Limits of Out-of-Distribution Detection Code
#8ERD (ResNet18)SOTA
94.3
AUROC· Extra Data· 2020-12-10
Semi-supervised novelty detection using ensembles with regularized disagreement Code
#9OpenHybridSOTA
85.6
AUROC· 2020-03-27
Hybrid Models for Open Set Recognition
#10Maximum Logit Score (MLS)
83.2
AUROC· 2021-10-12
Open-Set Recognition: a Good Closed-Set Classifier is All You Need?Code
#11WRN 40-2 + OECCSOTA
78.7
AUROC· Extra Data· 2019-06-08
Outlier Exposure with Confidence Control for Out-of-Distribution Detection Code
#12Joint contrastive and supervised training
78.3
AUROC· 2020-07-10
Contrastive Training for Improved Out-of-Distribution Detection
#13ResNet + diagonal elements of Gram matrix
76.6
AUROC· 2019-12-28
Detecting Out-of-Distribution Examples with In-distribution Examples and Gram Matrices Code
#14DenseNet + diagonal elements of Gram matrix
70.1
AUROC· 2019-12-28
Detecting Out-of-Distribution Examples with In-distribution Examples and Gram Matrices Code