TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Track to Detect and Segment: An Online Multi-Object Tracker

Track to Detect and Segment: An Online Multi-Object Tracker

Jialian Wu, Jiale Cao, Liangchen Song, Yu Wang, Ming Yang, Junsong Yuan

2021-03-16CVPR 2021 1Multi-Object TrackingSegmentationSemantic SegmentationObject TrackingInstance SegmentationOnline Multi-Object Tracking3D Multi-Object TrackingVideo Instance Segmentationobject-detectionObject Detection
PaperPDFCode(official)

Abstract

Most online multi-object trackers perform object detection stand-alone in a neural net without any input from tracking. In this paper, we present a new online joint detection and tracking model, TraDeS (TRAck to DEtect and Segment), exploiting tracking clues to assist detection end-to-end. TraDeS infers object tracking offset by a cost volume, which is used to propagate previous object features for improving current object detection and segmentation. Effectiveness and superiority of TraDeS are shown on 4 datasets, including MOT (2D tracking), nuScenes (3D tracking), MOTS and Youtube-VIS (instance segmentation tracking). Project page: https://jialianwu.com/projects/TraDeS.html.

Results

TaskDatasetMetricValueModel
Multi-Object TrackingMOTS20IDF158.7TraDes
Multi-Object TrackingMOTS20sMOTSA50.8TraDes
Multi-Object TrackingMOT15MOTA66.5Baseline+MFW
Multi-Object TrackingMOT17IDF163.9TraDeS
Multi-Object TrackingMOT17MOTA69.1TraDeS
Multi-Object TrackingMOT16IDF164.7TraDeS
Multi-Object TrackingMOT16MOTA70.1TraDeS
Multi-Object TrackingDanceTrackAssA25.4TraDes
Multi-Object TrackingDanceTrackDetA74.5TraDes
Multi-Object TrackingDanceTrackHOTA43.3TraDes
Multi-Object TrackingDanceTrackIDF141.2TraDes
Multi-Object TrackingDanceTrackMOTA86.2TraDes
Object TrackingMOTS20IDF158.7TraDes
Object TrackingMOTS20sMOTSA50.8TraDes
Object TrackingMOT15MOTA66.5Baseline+MFW
Object TrackingMOT17IDF163.9TraDeS
Object TrackingMOT17MOTA69.1TraDeS
Object TrackingMOT16IDF164.7TraDeS
Object TrackingMOT16MOTA70.1TraDeS
Object TrackingDanceTrackAssA25.4TraDes
Object TrackingDanceTrackDetA74.5TraDes
Object TrackingDanceTrackHOTA43.3TraDes
Object TrackingDanceTrackIDF141.2TraDes
Object TrackingDanceTrackMOTA86.2TraDes
Object TrackingMOT16MOTA67.7TraDeS
Instance SegmentationnuScenesMOTA68.2TraDeS
Video Instance SegmentationYouTube-VIS validationAP5052.6TraDeS
Video Instance SegmentationYouTube-VIS validationAP7532.8TraDeS
Video Instance SegmentationYouTube-VIS validationmask AP32.6TraDeS

Related Papers

SeC: Advancing Complex Video Object Segmentation via Progressive Concept Construction2025-07-21MVA 2025 Small Multi-Object Tracking for Spotting Birds Challenge: Dataset, Methods, and Results2025-07-17Deep Learning-Based Fetal Lung Segmentation from Diffusion-weighted MRI Images and Lung Maturity Evaluation for Fetal Growth Restriction2025-07-17DiffOSeg: Omni Medical Image Segmentation via Multi-Expert Collaboration Diffusion Model2025-07-17From Variability To Accuracy: Conditional Bernoulli Diffusion Models with Consensus-Driven Correction for Thin Structure Segmentation2025-07-17Unleashing Vision Foundation Models for Coronary Artery Segmentation: Parallel ViT-CNN Encoding and Variational Fusion2025-07-17SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentation2025-07-17Unified Medical Image Segmentation with State Space Modeling Snake2025-07-17