Likun Cai, Zhi Zhang, Yi Zhu, Li Zhang, Mu Li, xiangyang xue
Multiple datasets and open challenges for object detection have been introduced in recent years. To build more general and powerful object detection systems, in this paper, we construct a new large-scale benchmark termed BigDetection. Our goal is to simply leverage the training data from existing datasets (LVIS, OpenImages and Object365) with carefully designed principles, and curate a larger dataset for improved detector pre-training. Specifically, we generate a new taxonomy which unifies the heterogeneous label spaces from different sources. Our BigDetection dataset has 600 object categories and contains over 3.4M training images with 36M bounding boxes. It is much larger in multiple dimensions than previous benchmarks, which offers both opportunities and challenges. Extensive experiments demonstrate its validity as a new benchmark for evaluating different object detection methods, and its effectiveness as a pre-training dataset.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Object Detection | BigDetection val | AP | 24.1 | Cascade R-CNN (R50-FPN) |
| Object Detection | BigDetection val | AP50 | 33 | Cascade R-CNN (R50-FPN) |
| Object Detection | BigDetection val | AP75 | 25.8 | Cascade R-CNN (R50-FPN) |
| Object Detection | BigDetection val | AP | 23.1 | CenterNet2 (R50-FPN) |
| Object Detection | BigDetection val | AP50 | 30.2 | CenterNet2 (R50-FPN) |
| Object Detection | BigDetection val | AP75 | 24.9 | CenterNet2 (R50-FPN) |
| Object Detection | BigDetection val | AP | 19.4 | Faster R-CNN (R50-FPN) |
| Object Detection | BigDetection val | AP50 | 29.3 | Faster R-CNN (R50-FPN) |
| Object Detection | BigDetection val | AP75 | 21.3 | Faster R-CNN (R50-FPN) |
| Object Detection | BigDetection val | AP | 18.9 | Faster R-CNN (R50) |
| Object Detection | BigDetection val | AP50 | 28.8 | Faster R-CNN (R50) |
| Object Detection | BigDetection val | AP75 | 20.5 | Faster R-CNN (R50) |
| Object Detection | BigDetection val | AP | 13.1 | Deformable DETR (R50) |
| Object Detection | BigDetection val | AP50 | 19.3 | Deformable DETR (R50) |
| Object Detection | BigDetection val | AP75 | 14.2 | Deformable DETR (R50) |
| Object Detection | BigDetection val | AP | 9.7 | YOLOv3 (D53) |
| Object Detection | BigDetection val | AP50 | 17.4 | YOLOv3 (D53) |
| Object Detection | BigDetection val | AP75 | 9.7 | YOLOv3 (D53) |
| 3D | BigDetection val | AP | 24.1 | Cascade R-CNN (R50-FPN) |
| 3D | BigDetection val | AP50 | 33 | Cascade R-CNN (R50-FPN) |
| 3D | BigDetection val | AP75 | 25.8 | Cascade R-CNN (R50-FPN) |
| 3D | BigDetection val | AP | 23.1 | CenterNet2 (R50-FPN) |
| 3D | BigDetection val | AP50 | 30.2 | CenterNet2 (R50-FPN) |
| 3D | BigDetection val | AP75 | 24.9 | CenterNet2 (R50-FPN) |
| 3D | BigDetection val | AP | 19.4 | Faster R-CNN (R50-FPN) |
| 3D | BigDetection val | AP50 | 29.3 | Faster R-CNN (R50-FPN) |
| 3D | BigDetection val | AP75 | 21.3 | Faster R-CNN (R50-FPN) |
| 3D | BigDetection val | AP | 18.9 | Faster R-CNN (R50) |
| 3D | BigDetection val | AP50 | 28.8 | Faster R-CNN (R50) |
| 3D | BigDetection val | AP75 | 20.5 | Faster R-CNN (R50) |
| 3D | BigDetection val | AP | 13.1 | Deformable DETR (R50) |
| 3D | BigDetection val | AP50 | 19.3 | Deformable DETR (R50) |
| 3D | BigDetection val | AP75 | 14.2 | Deformable DETR (R50) |
| 3D | BigDetection val | AP | 9.7 | YOLOv3 (D53) |
| 3D | BigDetection val | AP50 | 17.4 | YOLOv3 (D53) |
| 3D | BigDetection val | AP75 | 9.7 | YOLOv3 (D53) |
| 2D Classification | BigDetection val | AP | 24.1 | Cascade R-CNN (R50-FPN) |
| 2D Classification | BigDetection val | AP50 | 33 | Cascade R-CNN (R50-FPN) |
| 2D Classification | BigDetection val | AP75 | 25.8 | Cascade R-CNN (R50-FPN) |
| 2D Classification | BigDetection val | AP | 23.1 | CenterNet2 (R50-FPN) |
| 2D Classification | BigDetection val | AP50 | 30.2 | CenterNet2 (R50-FPN) |
| 2D Classification | BigDetection val | AP75 | 24.9 | CenterNet2 (R50-FPN) |
| 2D Classification | BigDetection val | AP | 19.4 | Faster R-CNN (R50-FPN) |
| 2D Classification | BigDetection val | AP50 | 29.3 | Faster R-CNN (R50-FPN) |
| 2D Classification | BigDetection val | AP75 | 21.3 | Faster R-CNN (R50-FPN) |
| 2D Classification | BigDetection val | AP | 18.9 | Faster R-CNN (R50) |
| 2D Classification | BigDetection val | AP50 | 28.8 | Faster R-CNN (R50) |
| 2D Classification | BigDetection val | AP75 | 20.5 | Faster R-CNN (R50) |
| 2D Classification | BigDetection val | AP | 13.1 | Deformable DETR (R50) |
| 2D Classification | BigDetection val | AP50 | 19.3 | Deformable DETR (R50) |
| 2D Classification | BigDetection val | AP75 | 14.2 | Deformable DETR (R50) |
| 2D Classification | BigDetection val | AP | 9.7 | YOLOv3 (D53) |
| 2D Classification | BigDetection val | AP50 | 17.4 | YOLOv3 (D53) |
| 2D Classification | BigDetection val | AP75 | 9.7 | YOLOv3 (D53) |
| 2D Object Detection | BigDetection val | AP | 24.1 | Cascade R-CNN (R50-FPN) |
| 2D Object Detection | BigDetection val | AP50 | 33 | Cascade R-CNN (R50-FPN) |
| 2D Object Detection | BigDetection val | AP75 | 25.8 | Cascade R-CNN (R50-FPN) |
| 2D Object Detection | BigDetection val | AP | 23.1 | CenterNet2 (R50-FPN) |
| 2D Object Detection | BigDetection val | AP50 | 30.2 | CenterNet2 (R50-FPN) |
| 2D Object Detection | BigDetection val | AP75 | 24.9 | CenterNet2 (R50-FPN) |
| 2D Object Detection | BigDetection val | AP | 19.4 | Faster R-CNN (R50-FPN) |
| 2D Object Detection | BigDetection val | AP50 | 29.3 | Faster R-CNN (R50-FPN) |
| 2D Object Detection | BigDetection val | AP75 | 21.3 | Faster R-CNN (R50-FPN) |
| 2D Object Detection | BigDetection val | AP | 18.9 | Faster R-CNN (R50) |
| 2D Object Detection | BigDetection val | AP50 | 28.8 | Faster R-CNN (R50) |
| 2D Object Detection | BigDetection val | AP75 | 20.5 | Faster R-CNN (R50) |
| 2D Object Detection | BigDetection val | AP | 13.1 | Deformable DETR (R50) |
| 2D Object Detection | BigDetection val | AP50 | 19.3 | Deformable DETR (R50) |
| 2D Object Detection | BigDetection val | AP75 | 14.2 | Deformable DETR (R50) |
| 2D Object Detection | BigDetection val | AP | 9.7 | YOLOv3 (D53) |
| 2D Object Detection | BigDetection val | AP50 | 17.4 | YOLOv3 (D53) |
| 2D Object Detection | BigDetection val | AP75 | 9.7 | YOLOv3 (D53) |
| 16k | BigDetection val | AP | 24.1 | Cascade R-CNN (R50-FPN) |
| 16k | BigDetection val | AP50 | 33 | Cascade R-CNN (R50-FPN) |
| 16k | BigDetection val | AP75 | 25.8 | Cascade R-CNN (R50-FPN) |
| 16k | BigDetection val | AP | 23.1 | CenterNet2 (R50-FPN) |
| 16k | BigDetection val | AP50 | 30.2 | CenterNet2 (R50-FPN) |
| 16k | BigDetection val | AP75 | 24.9 | CenterNet2 (R50-FPN) |
| 16k | BigDetection val | AP | 19.4 | Faster R-CNN (R50-FPN) |
| 16k | BigDetection val | AP50 | 29.3 | Faster R-CNN (R50-FPN) |
| 16k | BigDetection val | AP75 | 21.3 | Faster R-CNN (R50-FPN) |
| 16k | BigDetection val | AP | 18.9 | Faster R-CNN (R50) |
| 16k | BigDetection val | AP50 | 28.8 | Faster R-CNN (R50) |
| 16k | BigDetection val | AP75 | 20.5 | Faster R-CNN (R50) |
| 16k | BigDetection val | AP | 13.1 | Deformable DETR (R50) |
| 16k | BigDetection val | AP50 | 19.3 | Deformable DETR (R50) |
| 16k | BigDetection val | AP75 | 14.2 | Deformable DETR (R50) |
| 16k | BigDetection val | AP | 9.7 | YOLOv3 (D53) |
| 16k | BigDetection val | AP50 | 17.4 | YOLOv3 (D53) |
| 16k | BigDetection val | AP75 | 9.7 | YOLOv3 (D53) |