TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/BEN: Using Confidence-Guided Matting for Dichotomous Image...

BEN: Using Confidence-Guided Matting for Dichotomous Image Segmentation

Maxwell Meyer, Jack Spruyt

2025-01-08Dichotomous Image SegmentationImage MattingSegmentationSemantic SegmentationImage Segmentation
PaperPDFCode(official)

Abstract

Current approaches to dichotomous image segmentation (DIS) treat image matting and object segmentation as fundamentally different tasks. As improvements in image segmentation become increasingly challenging to achieve, combining image matting and grayscale segmentation techniques offers promising new directions for architectural innovation. Inspired by the possibility of aligning these two model tasks, we propose a new architectural approach for DIS called Confidence-Guided Matting (CGM). We created the first CGM model called Background Erase Network (BEN). BEN is comprised of two components: BEN Base for initial segmentation and BEN Refiner for confidence refinement. Our approach achieves substantial improvements over current state-of-the-art methods on the DIS5K validation dataset, demonstrating that matting-based refinement can significantly enhance segmentation quality. This work opens new possibilities for cross-pollination between matting and segmentation techniques in computer vision.

Results

TaskDatasetMetricValueModel
Object DetectionDIS-VDE-measure0.935BEN_Base
Object DetectionDIS-VDMAE0.031BEN_Base
Object DetectionDIS-VDS-Measure0.916BEN_Base
Object DetectionDIS-VDmax F-Measure0.923BEN_Base
Object DetectionDIS-VDweighted F-measure0.871BEN_Base
Object DetectionDIS-VDE-measure0.958BEN_Base+Refiner
Object DetectionDIS-VDMAE0.027BEN_Base+Refiner
Object DetectionDIS-VDS-Measure0.917BEN_Base+Refiner
Object DetectionDIS-VDmax F-Measure0.919BEN_Base+Refiner
Object DetectionDIS-VDweighted F-measure0.896BEN_Base+Refiner
3DDIS-VDE-measure0.935BEN_Base
3DDIS-VDMAE0.031BEN_Base
3DDIS-VDS-Measure0.916BEN_Base
3DDIS-VDmax F-Measure0.923BEN_Base
3DDIS-VDweighted F-measure0.871BEN_Base
3DDIS-VDE-measure0.958BEN_Base+Refiner
3DDIS-VDMAE0.027BEN_Base+Refiner
3DDIS-VDS-Measure0.917BEN_Base+Refiner
3DDIS-VDmax F-Measure0.919BEN_Base+Refiner
3DDIS-VDweighted F-measure0.896BEN_Base+Refiner
RGB Salient Object DetectionDIS-VDE-measure0.935BEN_Base
RGB Salient Object DetectionDIS-VDMAE0.031BEN_Base
RGB Salient Object DetectionDIS-VDS-Measure0.916BEN_Base
RGB Salient Object DetectionDIS-VDmax F-Measure0.923BEN_Base
RGB Salient Object DetectionDIS-VDweighted F-measure0.871BEN_Base
RGB Salient Object DetectionDIS-VDE-measure0.958BEN_Base+Refiner
RGB Salient Object DetectionDIS-VDMAE0.027BEN_Base+Refiner
RGB Salient Object DetectionDIS-VDS-Measure0.917BEN_Base+Refiner
RGB Salient Object DetectionDIS-VDmax F-Measure0.919BEN_Base+Refiner
RGB Salient Object DetectionDIS-VDweighted F-measure0.896BEN_Base+Refiner
2D ClassificationDIS-VDE-measure0.935BEN_Base
2D ClassificationDIS-VDMAE0.031BEN_Base
2D ClassificationDIS-VDS-Measure0.916BEN_Base
2D ClassificationDIS-VDmax F-Measure0.923BEN_Base
2D ClassificationDIS-VDweighted F-measure0.871BEN_Base
2D ClassificationDIS-VDE-measure0.958BEN_Base+Refiner
2D ClassificationDIS-VDMAE0.027BEN_Base+Refiner
2D ClassificationDIS-VDS-Measure0.917BEN_Base+Refiner
2D ClassificationDIS-VDmax F-Measure0.919BEN_Base+Refiner
2D ClassificationDIS-VDweighted F-measure0.896BEN_Base+Refiner
2D Object DetectionDIS-VDE-measure0.935BEN_Base
2D Object DetectionDIS-VDMAE0.031BEN_Base
2D Object DetectionDIS-VDS-Measure0.916BEN_Base
2D Object DetectionDIS-VDmax F-Measure0.923BEN_Base
2D Object DetectionDIS-VDweighted F-measure0.871BEN_Base
2D Object DetectionDIS-VDE-measure0.958BEN_Base+Refiner
2D Object DetectionDIS-VDMAE0.027BEN_Base+Refiner
2D Object DetectionDIS-VDS-Measure0.917BEN_Base+Refiner
2D Object DetectionDIS-VDmax F-Measure0.919BEN_Base+Refiner
2D Object DetectionDIS-VDweighted F-measure0.896BEN_Base+Refiner
16kDIS-VDE-measure0.935BEN_Base
16kDIS-VDMAE0.031BEN_Base
16kDIS-VDS-Measure0.916BEN_Base
16kDIS-VDmax F-Measure0.923BEN_Base
16kDIS-VDweighted F-measure0.871BEN_Base
16kDIS-VDE-measure0.958BEN_Base+Refiner
16kDIS-VDMAE0.027BEN_Base+Refiner
16kDIS-VDS-Measure0.917BEN_Base+Refiner
16kDIS-VDmax F-Measure0.919BEN_Base+Refiner
16kDIS-VDweighted F-measure0.896BEN_Base+Refiner

Related Papers

SeC: Advancing Complex Video Object Segmentation via Progressive Concept Construction2025-07-21Deep Learning-Based Fetal Lung Segmentation from Diffusion-weighted MRI Images and Lung Maturity Evaluation for Fetal Growth Restriction2025-07-17DiffOSeg: Omni Medical Image Segmentation via Multi-Expert Collaboration Diffusion Model2025-07-17From Variability To Accuracy: Conditional Bernoulli Diffusion Models with Consensus-Driven Correction for Thin Structure Segmentation2025-07-17Unleashing Vision Foundation Models for Coronary Artery Segmentation: Parallel ViT-CNN Encoding and Variational Fusion2025-07-17SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation2025-07-17Unified Medical Image Segmentation with State Space Modeling Snake2025-07-17A Privacy-Preserving Semantic-Segmentation Method Using Domain-Adaptation Technique2025-07-17