TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Delving into the Cyclic Mechanism in Semi-supervised Video...

Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation

Yuxi Li, Ning Xu, Jinlong Peng, John See, Weiyao Lin

2020-10-23NeurIPS 2020 12Semi-Supervised Video Object SegmentationOne-shot visual object segmentationSegmentationSemantic SegmentationVideo Object SegmentationVideo Semantic Segmentation
PaperPDFCode(official)

Abstract

In this paper, we address several inadequacies of current video object segmentation pipelines. Firstly, a cyclic mechanism is incorporated to the standard semi-supervised process to produce more robust representations. By relying on the accurate reference mask in the starting frame, we show that the error propagation problem can be mitigated. Next, we introduce a simple gradient correction module, which extends the offline pipeline to an online method while maintaining the efficiency of the former. Finally we develop cycle effective receptive field (cycle-ERF) based on gradient correction to provide a new perspective into analyzing object-specific regions of interests. We conduct comprehensive experiments on challenging benchmarks of DAVIS17 and Youtube-VOS, demonstrating that the cyclic mechanism is beneficial to segmentation quality.

Results

TaskDatasetMetricValueModel
VideoYouTube-VOS 2018F-Measure (Seen)75.8STM-cycle
VideoYouTube-VOS 2018F-Measure (Unseen)70.4STM-cycle
VideoYouTube-VOS 2018Jaccard (Seen)71.7STM-cycle
VideoYouTube-VOS 2018Overall69.9STM-cycle
VideoYouTube-VOS 2018Speed (FPS)61.4STM-cycle
Video Object SegmentationYouTube-VOS 2018F-Measure (Seen)75.8STM-cycle
Video Object SegmentationYouTube-VOS 2018F-Measure (Unseen)70.4STM-cycle
Video Object SegmentationYouTube-VOS 2018Jaccard (Seen)71.7STM-cycle
Video Object SegmentationYouTube-VOS 2018Overall69.9STM-cycle
Video Object SegmentationYouTube-VOS 2018Speed (FPS)61.4STM-cycle
Semi-Supervised Video Object SegmentationYouTube-VOS 2018F-Measure (Seen)75.8STM-cycle
Semi-Supervised Video Object SegmentationYouTube-VOS 2018F-Measure (Unseen)70.4STM-cycle
Semi-Supervised Video Object SegmentationYouTube-VOS 2018Jaccard (Seen)71.7STM-cycle
Semi-Supervised Video Object SegmentationYouTube-VOS 2018Overall69.9STM-cycle
Semi-Supervised Video Object SegmentationYouTube-VOS 2018Speed (FPS)61.4STM-cycle

Related Papers

SeC: Advancing Complex Video Object Segmentation via Progressive Concept Construction2025-07-21Deep Learning-Based Fetal Lung Segmentation from Diffusion-weighted MRI Images and Lung Maturity Evaluation for Fetal Growth Restriction2025-07-17DiffOSeg: Omni Medical Image Segmentation via Multi-Expert Collaboration Diffusion Model2025-07-17From Variability To Accuracy: Conditional Bernoulli Diffusion Models with Consensus-Driven Correction for Thin Structure Segmentation2025-07-17Unleashing Vision Foundation Models for Coronary Artery Segmentation: Parallel ViT-CNN Encoding and Variational Fusion2025-07-17SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation2025-07-17Unified Medical Image Segmentation with State Space Modeling Snake2025-07-17A Privacy-Preserving Semantic-Segmentation Method Using Domain-Adaptation Technique2025-07-17