Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Models/MOS (BiT-S-R101x1)

MOS (BiT-S-R101x1)

Reported on 10 benchmarks across 1 task · 1 paper · 9 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Computer Vision10 results

Out-of-Distribution DetectiononImageNet-1k vs iNaturalist
AUROC· 2021-05-05
98.15
best: 99.62 (CMA(ViT-B/16, NegLabel))
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs iNaturalist
FPR95· 2021-05-05
9.28
best: 68.32 (GEN)
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs Textures
FPR95· uses extra data· 2021-05-05
60.43
best: 79.8 (RP+GradNorm)
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs Places
AUROC· uses extra data· 2021-05-05
89.06
best: 93.11 (CMA(ViT-B/16, NegLabel))
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs Places
FPR95· uses extra data· 2021-05-05
49.54
best: 83.29 (RP+GradNorm)
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs SUN
AUROC· uses extra data· 2021-05-05
92.01
best: 96.36 (CMA(ViT-B/16, NegLabel))
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs SUN
FPR95· uses extra data· 2021-05-05
40.63
best: 80.94 (DOE)
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs Curated OODs (avg.)
AUROC· 2021-05-05
90.11
best: 95.71 (SCALE (ResNet50))
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs Curated OODs (avg.)
FPR95· 2021-05-05
39.97
best: 70.12 (RP+GradNorm)
SOTA
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879
Out-of-Distribution DetectiononImageNet-1k vs Textures
AUROC· uses extra data· 2021-05-05
81.23
best: 98.92 (ViM (BiT))
MOS: Towards Scaling Out-of-distribution Detection for Large Semantic Space arXiv:2105.01879