Semantic Segmentation on MFN Dataset

Metric: mIOU (higher is better)

LeaderboardDataset

Loading chart...

Results

Sort:

#	Model↕	mIOU▼	Extra Data	Paper	Date↕	Code
1	RoadFormer+ (ConvNeXt-L)	62.7	No	RoadFormer+: Delivering RGB-X Scene Parsing thro...	2024-07-31	-
2	HAPNet	61.5	No	HAPNet: Toward Superior RGB-Thermal Scene Parsin...	2024-04-04	Code
3	CRM_RGBT_Seg	61.4	No	Complementary Random Masking for RGB-Thermal Sem...	2023-03-30	Code
4	Sigma-base	61.3	No	Sigma: Siamese Mamba Network for Multi-Modal Sem...	2024-04-05	Code
5	CSFNet-2	59.98	No	CSFNet: A Cosine Similarity Fusion Network for R...	2024-07-01	Code
6	CMNeXt (B4)	59.9	No	Delivering Arbitrary-Modal Semantic Segmentation	2023-03-02	Code
7	CMX (B4)	59.7	No	CMX: Cross-Modal Fusion for RGB-X Semantic Segme...	2022-03-09	Code
8	DPLNet	59.3	No	Efficient Multimodal Semantic Segmentation via D...	2023-12-01	Code
9	UniRGB-IR	59.3	No	UniRGB-IR: A Unified Framework for RGB-Infrared ...	2024-04-26	Code
10	SHIFNet	59.2	No	Unveiling the Potential of Segment Anything Mode...	2025-03-04	Code
11	IGFNet(B2)	59	No	-	-	Code
12	EAEFNet (ResNet-152)	58.9	No	Explicit Attention-Enhanced Fusion for RGB-Therm...	2023-03-28	Code
13	SpiderMesh (B4)	58.4	No	SpiderMesh: Spatial-aware Demand-guided Recursiv...	2023-03-15	Code
14	CMX (B2)	58.2	No	CMX: Cross-Modal Fusion for RGB-X Semantic Segme...	2022-03-09	Code
15	StitchFusion	58.13	No	StitchFusion: Weaving Any Visual Modalities to E...	2024-08-02	Code
16	SpiderMesh (ResNet-152)	57.9	No	SpiderMesh: Spatial-aware Demand-guided Recursiv...	2023-03-15	Code
17	CACFNet	57.8	No	-	-	-
18	VPFNet	57.61	No	Variational Probabilistic Fusion Network for RGB...	2023-07-17	-
19	EGFNet(ConvNeXt)	57.5	No	-	-	Code
20	DooDLeNet	57.3	No	DooDLeNet: Double DeepLab Enhanced Feature Fusio...	2022-04-21	-
21	PAIF	56.5	No	PAIF: Perception-Aware Infrared-Visible Image Fu...	2023-08-08	Code
22	RSFNet (ResNet-101)	56.2	No	Residual Spatial Fusion Network for RGB-Thermal ...	2023-06-17	-
23	GEBNet	56.2	No	-	-	-
24	SegMiF	56.1	No	Multi-interactive Feature Learning and a Full-ti...	2023-08-04	Code
25	SpiderMesh (ResNet-101)	56.1	No	SpiderMesh: Spatial-aware Demand-guided Recursiv...	2023-03-15	Code
26	MTANet	56.1	No	-	-	-
27	CENet	56.1	No	-	-	Code
28	CSFNet-1	56.05	No	CSFNet: A Cosine Similarity Fusion Network for R...	2024-07-01	Code
29	CSRPNet	56	No	Channel and Spatial Relation-Propagation Network...	2023-08-24	-
30	EAFFNet (ResNet-50)	55.9	No	Explicit Attention-Enhanced Fusion for RGB-Therm...	2023-03-28	Code
31	FEANet	55.3	No	FEANet: Feature-Enhanced Attention Network for R...	2021-10-18	Code
32	LASNet	54.9	No	RGB-T Semantic Segmentation with Location, Activ...	2022-10-26	Code
33	ABMDRNet	54.8	No	-	-	-
34	EGFNet	54.8	No	Edge-aware Guidance Fusion Network for RGB Therm...	2021-12-09	Code
35	SegFormer (B4)	54.8	No	SegFormer: Simple and Efficient Design for Seman...	2021-05-31	Code
36	SpiderMesh (ResNet-50)	54.4	No	SpiderMesh: Spatial-aware Demand-guided Recursiv...	2023-03-15	Code
37	SegFormer (B2)	53.2	No	SegFormer: Simple and Efficient Design for Seman...	2021-05-31	Code
38	RTFNet	53.2	No	-	-	Code
39	HRNet	51.7	No	Deep High-Resolution Representation Learning for...	2019-08-20	Code
40	APCNet	49	No	-	-	Code
41	SwinT	49	No	Swin Transformer: Hierarchical Vision Transforme...	2021-03-25	Code
42	PST900	48.4	No	PST900: RGB-Thermal Calibration, Dataset and Seg...	2019-09-20	Code
43	FTNet	47.12	No	-	-	Code
44	ACNet	46.3	No	ACNet: Attention Based Network to Exploit Comple...	2019-05-24	Code
45	Depth-aware CNN	46.1	No	Depth-aware CNN for RGB-D Segmentation	2018-03-19	Code
46	PSPNet	46.1	No	Pyramid Scene Parsing Network	2016-12-04	Code
47	SA-Gate	45.8	No	Bi-directional Cross-Modality Feature Propagatio...	2020-07-17	Code
48	UNet	45.1	No	U-Net: Convolutional Networks for Biomedical Ima...	2015-05-18	Code
49	FRRN	44.2	No	Full-Resolution Residual Networks for Semantic S...	2016-11-24	Code
50	CCNet	43.3	No	CCNet: Criss-Cross Attention for Semantic Segmen...	2018-11-28	Code
51	SegNet	42.3	No	SegNet: A Deep Convolutional Encoder-Decoder Arc...	2015-11-02	Code
52	DANet	41.3	No	Dual Attention Network for Scene Segmentation	2018-09-09	Code
53	MFNet	39.7	No	-	-	-
54	ERFNet	36.1	No	-	-	Code

#1RoadFormer+ (ConvNeXt-L)SOTA
62.7
mIOU· 2024-07-31
RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusion
#2HAPNetSOTA
61.5
mIOU· 2024-04-04
HAPNet: Toward Superior RGB-Thermal Scene Parsing via Hybrid, Asymmetric, and Progressive Heterogeneous Feature Fusion Code
#3CRM_RGBT_SegSOTA
61.4
mIOU· 2023-03-30
Complementary Random Masking for RGB-Thermal Semantic Segmentation Code
#4Sigma-base
61.3
mIOU· 2024-04-05
Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation Code
#5CSFNet-2
59.98
mIOU· 2024-07-01
CSFNet: A Cosine Similarity Fusion Network for Real-Time RGB-X Semantic Segmentation of Driving Scenes Code
#6CMNeXt (B4)SOTA
59.9
mIOU· 2023-03-02
Delivering Arbitrary-Modal Semantic Segmentation Code
#7CMX (B4)SOTA
59.7
mIOU· 2022-03-09
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers Code
#8DPLNet
59.3
mIOU· 2023-12-01
Efficient Multimodal Semantic Segmentation via Dual-Prompt Learning Code
#9UniRGB-IR
59.3
mIOU· 2024-04-26
UniRGB-IR: A Unified Framework for RGB-Infrared Semantic Tasks via Adapter Tuning Code
#10SHIFNet
59.2
mIOU· 2025-03-04
Unveiling the Potential of Segment Anything Model 2 for RGB-Thermal Semantic Segmentation with Language Guidance Code
#11IGFNet(B2)
59
mIOU
No paperCode
#12EAEFNet (ResNet-152)
58.9
mIOU· 2023-03-28
Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Tasks Code
#13SpiderMesh (B4)
58.4
mIOU· 2023-03-15
SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation Code
#14CMX (B2)
58.2
mIOU· 2022-03-09
CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers Code
#15StitchFusion
58.13
mIOU· 2024-08-02
StitchFusion: Weaving Any Visual Modalities to Enhance Multimodal Semantic Segmentation Code
#16SpiderMesh (ResNet-152)
57.9
mIOU· 2023-03-15
SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation Code
#17CACFNet
57.8
mIOU
No paper
#18VPFNet
57.61
mIOU· 2023-07-17
Variational Probabilistic Fusion Network for RGB-T Semantic Segmentation
#19EGFNet(ConvNeXt)
57.5
mIOU
No paperCode
#20DooDLeNet
57.3
mIOU· 2022-04-21
DooDLeNet: Double DeepLab Enhanced Feature Fusion for Thermal-color Semantic Segmentation
#21PAIF
56.5
mIOU· 2023-08-08
PAIF: Perception-Aware Infrared-Visible Image Fusion for Attack-Tolerant Semantic Segmentation Code
#22RSFNet (ResNet-101)
56.2
mIOU· 2023-06-17
Residual Spatial Fusion Network for RGB-Thermal Semantic Segmentation
#23GEBNet
56.2
mIOU
No paper
#24SegMiF
56.1
mIOU· 2023-08-04
Multi-interactive Feature Learning and a Full-time Multi-modality Benchmark for Image Fusion and Segmentation Code
#25SpiderMesh (ResNet-101)
56.1
mIOU· 2023-03-15
SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation Code
#26MTANet
56.1
mIOU
No paper
#27CENet
56.1
mIOU
No paperCode
#28CSFNet-1
56.05
mIOU· 2024-07-01
CSFNet: A Cosine Similarity Fusion Network for Real-Time RGB-X Semantic Segmentation of Driving Scenes Code
#29CSRPNet
56
mIOU· 2023-08-24
Channel and Spatial Relation-Propagation Network for RGB-Thermal Semantic Segmentation
#30EAFFNet (ResNet-50)
55.9
mIOU· 2023-03-28
Explicit Attention-Enhanced Fusion for RGB-Thermal Perception Tasks Code
#31FEANetSOTA
55.3
mIOU· 2021-10-18
FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentation Code
#32LASNet
54.9
mIOU· 2022-10-26
RGB-T Semantic Segmentation with Location, Activation, and Sharpening Code
#33ABMDRNet
54.8
mIOU
No paper
#34EGFNet
54.8
mIOU· 2021-12-09
Edge-aware Guidance Fusion Network for RGB Thermal Scene Parsing Code
#35SegFormer (B4)SOTA
54.8
mIOU· 2021-05-31
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers Code
#36SpiderMesh (ResNet-50)
54.4
mIOU· 2023-03-15
SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation Code
#37SegFormer (B2)
53.2
mIOU· 2021-05-31
SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers Code
#38RTFNet
53.2
mIOU
No paperCode
#39HRNetSOTA
51.7
mIOU· 2019-08-20
Deep High-Resolution Representation Learning for Visual Recognition Code
#40APCNet
49
mIOU
No paperCode
#41SwinT
49
mIOU· 2021-03-25
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows Code
#42PST900
48.4
mIOU· 2019-09-20
PST900: RGB-Thermal Calibration, Dataset and Segmentation Network Code
#43FTNet
47.12
mIOU
No paperCode
#44ACNetSOTA
46.3
mIOU· 2019-05-24
ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentation Code
#45Depth-aware CNN
46.1
mIOU· 2018-03-19
Depth-aware CNN for RGB-D Segmentation Code
#46PSPNetSOTA
46.1
mIOU· 2016-12-04
Pyramid Scene Parsing Network Code
#47SA-Gate
45.8
mIOU· 2020-07-17
Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentation Code
#48UNetSOTA
45.1
mIOU· 2015-05-18
U-Net: Convolutional Networks for Biomedical Image Segmentation Code
#49FRRN
44.2
mIOU· 2016-11-24
Full-Resolution Residual Networks for Semantic Segmentation in Street Scenes Code
#50CCNet
43.3
mIOU· 2018-11-28
CCNet: Criss-Cross Attention for Semantic Segmentation Code
#51SegNet
42.3
mIOU· 2015-11-02
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation Code
#52DANet
41.3
mIOU· 2018-09-09
Dual Attention Network for Scene Segmentation Code
#53MFNet
39.7
mIOU
No paper
#54ERFNet
36.1
mIOU
No paperCode