Unsupervised Semantic Segmentation on COCO-Stuff-27

Metric: Clustering [Accuracy] (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	Clustering [Accuracy]▼	Extra Data	Paper	Date↕	Code
1	DynaSeg - FSF (ResNet-18 FPN)	81.1	No	DynaSeg: A Deep Dynamic Fusion Method for Unsupe...	2024-05-09	Code
2	CAUSE (DINOv2, ViT-B/14)	78	No	Causal Unsupervised Semantic Segmentation	2023-10-11	Code
3	CAUSE (ViT-B/8)	74.9	No	Causal Unsupervised Semantic Segmentation	2023-10-11	Code
4	ViCE	64.8	No	ViCE: Improving Dense Representation Learning by...	2021-11-24	Code
5	EAGLE (DINO, ViT-S/8)	64.2	No	EAGLE: Eigen Aggregation Learning for Object-Cen...	2024-03-03	Code
6	U2Seg	63.9	No	Unsupervised Universal Image Segmentation	2023-12-28	Code
7	SmooSeg (DINO, ViT-S/8)	63.2	No	-	-	-
8	DepthG (ViT-B/8)	58.6	No	Unsupervised Semantic Segmentation Through Depth...	2023-09-21	Code
9	PriMaPs+STEGO (DINO ViT-B/8)	57.9	No	Boosting Unsupervised Semantic Segmentation with...	2024-04-25	Code
10	PriMaPs+HP (DINO ViT-S/8)	57.8	No	Boosting Unsupervised Semantic Segmentation with...	2024-04-25	Code
11	HP (ViT-S/8)	57.2	No	Leveraging Hidden Positives for Unsupervised Sem...	2023-03-27	Code
12	STEGO (ViT-B/8)	56.9	No	Unsupervised Semantic Segmentation by Distilling...	2022-03-16	Code
13	DepthG (ViT-S/8)	56.3	No	Unsupervised Semantic Segmentation Through Depth...	2023-09-21	Code
14	SGSeg	55.7	No	Unsupervised Image Semantic Segmentation through...	2022-10-21	-
15	DepthG w/ 3D-LHP (ViT-S/8)	55.1	No	Unsupervised Semantic Segmentation Through Depth...	2023-09-21	Code
16	HP (ViT-S/16)	54.5	No	Leveraging Hidden Positives for Unsupervised Sem...	2023-03-27	Code
17	EQUSS	53.8	No	Expand-and-Quantize: Unsupervised Semantic Segme...	2023-12-12	-
18	EQUSS (ViT-S)	53.8	No	Expand-and-Quantize: Unsupervised Semantic Segme...	2023-12-12	-
19	SAN	52	No	Rethinking Alignment and Uniformity in Unsupervi...	2022-11-26	-
20	PiCIE + H	49.99	No	PiCIE: Unsupervised Semantic Segmentation using ...	2021-03-30	Code
21	PiCIE	48.1	No	PiCIE: Unsupervised Semantic Segmentation using ...	2021-03-30	Code
22	Ours (SlotCon)	42.36	No	Self-Supervised Visual Representation Learning w...	2022-05-30	Code
23	FS4	40.38	No	Fully Self-Supervised Learning for Semantic Segm...	2022-02-24	-
24	IIC	21.8	No	Invariant Information Clustering for Unsupervise...	2018-07-17	Code

#1DynaSeg - FSF (ResNet-18 FPN)SOTA
81.1
Clustering [Accuracy]· 2024-05-09
DynaSeg: A Deep Dynamic Fusion Method for Unsupervised Image Segmentation Incorporating Feature Similarity and Spatial Continuity Code
#2CAUSE (DINOv2, ViT-B/14)SOTA
78
Clustering [Accuracy]· 2023-10-11
Causal Unsupervised Semantic Segmentation Code
#3CAUSE (ViT-B/8)
74.9
Clustering [Accuracy]· 2023-10-11
Causal Unsupervised Semantic Segmentation Code
#4ViCESOTA
64.8
Clustering [Accuracy]· 2021-11-24
ViCE: Improving Dense Representation Learning by Superpixelization and Contrasting Cluster Assignment Code
#5EAGLE (DINO, ViT-S/8)
64.2
Clustering [Accuracy]· 2024-03-03
EAGLE: Eigen Aggregation Learning for Object-Centric Unsupervised Semantic Segmentation Code
#6U2Seg
63.9
Clustering [Accuracy]· 2023-12-28
Unsupervised Universal Image Segmentation Code
#7SmooSeg (DINO, ViT-S/8)
63.2
Clustering [Accuracy]
No paper
#8DepthG (ViT-B/8)
58.6
Clustering [Accuracy]· 2023-09-21
Unsupervised Semantic Segmentation Through Depth-Guided Feature Correlation and Sampling Code
#9PriMaPs+STEGO (DINO ViT-B/8)
57.9
Clustering [Accuracy]· 2024-04-25
Boosting Unsupervised Semantic Segmentation with Principal Mask Proposals Code
#10PriMaPs+HP (DINO ViT-S/8)
57.8
Clustering [Accuracy]· 2024-04-25
Boosting Unsupervised Semantic Segmentation with Principal Mask Proposals Code
#11HP (ViT-S/8)
57.2
Clustering [Accuracy]· 2023-03-27
Leveraging Hidden Positives for Unsupervised Semantic Segmentation Code
#12STEGO (ViT-B/8)
56.9
Clustering [Accuracy]· 2022-03-16
Unsupervised Semantic Segmentation by Distilling Feature Correspondences Code
#13DepthG (ViT-S/8)
56.3
Clustering [Accuracy]· 2023-09-21
Unsupervised Semantic Segmentation Through Depth-Guided Feature Correlation and Sampling Code
#14SGSeg
55.7
Clustering [Accuracy]· 2022-10-21
Unsupervised Image Semantic Segmentation through Superpixels and Graph Neural Networks
#15DepthG w/ 3D-LHP (ViT-S/8)
55.1
Clustering [Accuracy]· 2023-09-21
Unsupervised Semantic Segmentation Through Depth-Guided Feature Correlation and Sampling Code
#16HP (ViT-S/16)
54.5
Clustering [Accuracy]· 2023-03-27
Leveraging Hidden Positives for Unsupervised Semantic Segmentation Code
#17EQUSS
53.8
Clustering [Accuracy]· 2023-12-12
Expand-and-Quantize: Unsupervised Semantic Segmentation Using High-Dimensional Space and Product Quantization
#18EQUSS (ViT-S)
53.8
Clustering [Accuracy]· 2023-12-12
Expand-and-Quantize: Unsupervised Semantic Segmentation Using High-Dimensional Space and Product Quantization
#19SAN
52
Clustering [Accuracy]· 2022-11-26
Rethinking Alignment and Uniformity in Unsupervised Semantic Segmentation
#20PiCIE + HSOTA
49.99
Clustering [Accuracy]· 2021-03-30
PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering Code
#21PiCIE
48.1
Clustering [Accuracy]· 2021-03-30
PiCIE: Unsupervised Semantic Segmentation using Invariance and Equivariance in Clustering Code
#22Ours (SlotCon)
42.36
Clustering [Accuracy]· 2022-05-30
Self-Supervised Visual Representation Learning with Semantic Grouping Code
#23FS4
40.38
Clustering [Accuracy]· 2022-02-24
Fully Self-Supervised Learning for Semantic Segmentation
#24IICSOTA
21.8
Clustering [Accuracy]· 2018-07-17
Invariant Information Clustering for Unsupervised Image Classification and Segmentation Code