TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/RobMOT: Robust 3D Multi-Object Tracking by Observational N...

RobMOT: Robust 3D Multi-Object Tracking by Observational Noise and State Estimation Drift Mitigation on LiDAR PointCloud

Mohamed Nagy, Naoufel Werghi, Bilal Hassan, Jorge Dias, Majid Khonji

2024-05-19Multi-Object TrackingReal-Time Multi-Object TrackingObject TrackingMultiple Object Tracking3D Multi-Object Tracking
PaperPDFCode

Abstract

This paper addresses limitations in 3D tracking-by-detection methods, particularly in identifying legitimate trajectories and reducing state estimation drift in Kalman filters. Existing methods often use threshold-based filtering for detection scores, which can fail for distant and occluded objects, leading to false positives. To tackle this, we propose a novel track validity mechanism and multi-stage observational gating process, significantly reducing ghost tracks and enhancing tracking performance. Our method achieves a $29.47\%$ improvement in Multi-Object Tracking Accuracy (MOTA) on the KITTI validation dataset with the Second detector. Additionally, a refined Kalman filter term reduces localization noise, improving higher-order tracking accuracy (HOTA) by $4.8\%$. The online framework, RobMOT, outperforms state-of-the-art methods across multiple detectors, with HOTA improvements of up to $3.92\%$ on the KITTI testing dataset and $8.7\%$ on the validation dataset, while achieving low identity switch scores. RobMOT excels in challenging scenarios, tracking distant objects and prolonged occlusions, with a $1.77\%$ MOTA improvement on the Waymo Open dataset, and operates at a remarkable 3221 FPS on a single CPU, proving its efficiency for real-time multi-object tracking.

Results

TaskDatasetMetricValueModel
VideoKITTI Test (Online Methods)HOTA81.76RobMOT
VideoKITTI Test (Online Methods)IDSW7RobMOT
VideoKITTI Test (Online Methods)MOTA91.02RobMOT
Multi-Object TrackingWaymo Open Dataset: Vehicle (Online Methods)FP/L20.0703RobMOT
Multi-Object TrackingWaymo Open Dataset: Vehicle (Online Methods)MOTA/L10.7772RobMOT
Multi-Object TrackingWaymo Open Dataset: Vehicle (Online Methods)MOTA/L20.7466RobMOT
Object TrackingWaymo Open Dataset: Vehicle (Online Methods)FP/L20.0703RobMOT
Object TrackingWaymo Open Dataset: Vehicle (Online Methods)MOTA/L10.7772RobMOT
Object TrackingWaymo Open Dataset: Vehicle (Online Methods)MOTA/L20.7466RobMOT
Object TrackingKITTI Test (Online Methods)HOTA81.76RobMOT
Object TrackingKITTI Test (Online Methods)IDSW7RobMOT
Object TrackingKITTI Test (Online Methods)MOTA91.02RobMOT
3D Multi-Object TrackingWaymo Open Dataset: Vehicle (Online Methods)FP/L20.0703RobMOT
3D Multi-Object TrackingWaymo Open Dataset: Vehicle (Online Methods)MOTA/L10.7772RobMOT
3D Multi-Object TrackingWaymo Open Dataset: Vehicle (Online Methods)MOTA/L20.7466RobMOT
Multiple Object TrackingKITTI Test (Online Methods)HOTA81.76RobMOT
Multiple Object TrackingKITTI Test (Online Methods)IDSW7RobMOT
Multiple Object TrackingKITTI Test (Online Methods)MOTA91.02RobMOT

Related Papers

MVA 2025 Small Multi-Object Tracking for Spotting Birds Challenge: Dataset, Methods, and Results2025-07-17YOLOv8-SMOT: An Efficient and Robust Framework for Real-Time Small Object Tracking via Slice-Assisted Training and Adaptive Association2025-07-16HiM2SAM: Enhancing SAM2 with Hierarchical Motion Estimation and Memory Optimization towards Long-term Tracking2025-07-10Robustifying 3D Perception through Least-Squares Multi-Agent Graphs Object Tracking2025-07-07UMDATrack: Unified Multi-Domain Adaptive Tracking Under Adverse Weather Conditions2025-07-01Mamba-FETrack V2: Revisiting State Space Model for Frame-Event based Visual Object Tracking2025-06-30Visual and Memory Dual Adapter for Multi-Modal Object Tracking2025-06-30R1-Track: Direct Application of MLLMs to Visual Object Tracking via Reinforcement Learning2025-06-27