Zhi Tian, Chunhua Shen, Hao Chen, Tong He
We propose a fully convolutional one-stage object detector (FCOS) to solve object detection in a per-pixel prediction fashion, analogue to semantic segmentation. Almost all state-of-the-art object detectors such as RetinaNet, SSD, YOLOv3, and Faster R-CNN rely on pre-defined anchor boxes. In contrast, our proposed detector FCOS is anchor box free, as well as proposal free. By eliminating the predefined set of anchor boxes, FCOS completely avoids the complicated computation related to anchor boxes such as calculating overlapping during training. More importantly, we also avoid all hyper-parameters related to anchor boxes, which are often very sensitive to the final detection performance. With the only post-processing non-maximum suppression (NMS), FCOS with ResNeXt-64x4d-101 achieves 44.7% in AP with single-model and single-scale testing, surpassing previous one-stage detectors with the advantage of being much simpler. For the first time, we demonstrate a much simpler and flexible detection framework achieving improved detection accuracy. We hope that the proposed FCOS framework can serve as a simple and strong alternative for many other instance-level tasks. Code is available at:Code is available at: https://tinyurl.com/FCOSv1
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Autonomous Vehicles | TJU-Ped-traffic | ALL (miss rate) | 40.02 | FCOS |
| Autonomous Vehicles | TJU-Ped-traffic | HO (miss rate) | 63.73 | FCOS |
| Autonomous Vehicles | TJU-Ped-traffic | R (miss rate) | 24.35 | FCOS |
| Autonomous Vehicles | TJU-Ped-traffic | R+HO (miss rate) | 28.86 | FCOS |
| Autonomous Vehicles | TJU-Ped-traffic | RS (miss rate) | 37.4 | FCOS |
| Autonomous Vehicles | TJU-Ped-campus | ALL (miss rate) | 41.62 | FCOS |
| Autonomous Vehicles | TJU-Ped-campus | HO (miss rate) | 81.28 | FCOS |
| Autonomous Vehicles | TJU-Ped-campus | R (miss rate) | 31.89 | FCOS |
| Autonomous Vehicles | TJU-Ped-campus | R+HO (miss rate) | 39.38 | FCOS |
| Autonomous Vehicles | TJU-Ped-campus | RS (miss rate) | 69.04 | FCOS |
| Object Detection | COCO test-dev | AP50 | 64.1 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| Object Detection | COCO test-dev | AP75 | 48.4 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| Object Detection | COCO test-dev | APL | 55.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| Object Detection | COCO test-dev | APM | 47.5 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| Object Detection | COCO test-dev | APS | 27.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| Object Detection | COCO test-dev | box mAP | 44.7 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| Object Detection | COCO test-dev | AP50 | 62.8 | FCOS (ResNeXt-101-64x4d-FPN) |
| Object Detection | COCO test-dev | AP75 | 46.6 | FCOS (ResNeXt-101-64x4d-FPN) |
| Object Detection | COCO test-dev | APL | 53.3 | FCOS (ResNeXt-101-64x4d-FPN) |
| Object Detection | COCO test-dev | APM | 46.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| Object Detection | COCO test-dev | APS | 26.5 | FCOS (ResNeXt-101-64x4d-FPN) |
| Object Detection | COCO test-dev | box mAP | 43.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| Object Detection | COCO test-dev | AP50 | 62.2 | FCOS (ResNeXt-32x8d-101-FPN) |
| Object Detection | COCO test-dev | AP75 | 46.1 | FCOS (ResNeXt-32x8d-101-FPN) |
| Object Detection | COCO test-dev | APL | 52.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| Object Detection | COCO test-dev | APM | 45.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| Object Detection | COCO test-dev | APS | 26 | FCOS (ResNeXt-32x8d-101-FPN) |
| Object Detection | COCO test-dev | box mAP | 42.7 | FCOS (ResNeXt-32x8d-101-FPN) |
| Object Detection | COCO test-dev | AP50 | 60.4 | FCOS (HRNet-W32-5l) |
| Object Detection | COCO test-dev | AP75 | 45.3 | FCOS (HRNet-W32-5l) |
| Object Detection | COCO test-dev | APL | 51 | FCOS (HRNet-W32-5l) |
| Object Detection | COCO test-dev | APM | 45 | FCOS (HRNet-W32-5l) |
| Object Detection | COCO test-dev | APS | 25.4 | FCOS (HRNet-W32-5l) |
| Object Detection | COCO test-dev | box mAP | 42 | FCOS (HRNet-W32-5l) |
| Object Detection | COCO-O | Average mAP | 16.7 | FCOS (ResNet-50) |
| Object Detection | COCO-O | Effective Robustness | 0.25 | FCOS (ResNet-50) |
| Object Detection | COCO minival | AP50 | 57.4 | FCOS (ResNet-50-FPN + improvements) |
| Object Detection | COCO minival | AP75 | 41.4 | FCOS (ResNet-50-FPN + improvements) |
| Object Detection | COCO minival | APL | 49.8 | FCOS (ResNet-50-FPN + improvements) |
| Object Detection | COCO minival | APM | 42.5 | FCOS (ResNet-50-FPN + improvements) |
| Object Detection | COCO minival | APS | 22.3 | FCOS (ResNet-50-FPN + improvements) |
| Object Detection | COCO minival | box AP | 38.6 | FCOS (ResNet-50-FPN + improvements) |
| 3D | COCO test-dev | AP50 | 64.1 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 3D | COCO test-dev | AP75 | 48.4 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 3D | COCO test-dev | APL | 55.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 3D | COCO test-dev | APM | 47.5 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 3D | COCO test-dev | APS | 27.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 3D | COCO test-dev | box mAP | 44.7 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 3D | COCO test-dev | AP50 | 62.8 | FCOS (ResNeXt-101-64x4d-FPN) |
| 3D | COCO test-dev | AP75 | 46.6 | FCOS (ResNeXt-101-64x4d-FPN) |
| 3D | COCO test-dev | APL | 53.3 | FCOS (ResNeXt-101-64x4d-FPN) |
| 3D | COCO test-dev | APM | 46.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| 3D | COCO test-dev | APS | 26.5 | FCOS (ResNeXt-101-64x4d-FPN) |
| 3D | COCO test-dev | box mAP | 43.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| 3D | COCO test-dev | AP50 | 62.2 | FCOS (ResNeXt-32x8d-101-FPN) |
| 3D | COCO test-dev | AP75 | 46.1 | FCOS (ResNeXt-32x8d-101-FPN) |
| 3D | COCO test-dev | APL | 52.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| 3D | COCO test-dev | APM | 45.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| 3D | COCO test-dev | APS | 26 | FCOS (ResNeXt-32x8d-101-FPN) |
| 3D | COCO test-dev | box mAP | 42.7 | FCOS (ResNeXt-32x8d-101-FPN) |
| 3D | COCO test-dev | AP50 | 60.4 | FCOS (HRNet-W32-5l) |
| 3D | COCO test-dev | AP75 | 45.3 | FCOS (HRNet-W32-5l) |
| 3D | COCO test-dev | APL | 51 | FCOS (HRNet-W32-5l) |
| 3D | COCO test-dev | APM | 45 | FCOS (HRNet-W32-5l) |
| 3D | COCO test-dev | APS | 25.4 | FCOS (HRNet-W32-5l) |
| 3D | COCO test-dev | box mAP | 42 | FCOS (HRNet-W32-5l) |
| 3D | COCO-O | Average mAP | 16.7 | FCOS (ResNet-50) |
| 3D | COCO-O | Effective Robustness | 0.25 | FCOS (ResNet-50) |
| 3D | COCO minival | AP50 | 57.4 | FCOS (ResNet-50-FPN + improvements) |
| 3D | COCO minival | AP75 | 41.4 | FCOS (ResNet-50-FPN + improvements) |
| 3D | COCO minival | APL | 49.8 | FCOS (ResNet-50-FPN + improvements) |
| 3D | COCO minival | APM | 42.5 | FCOS (ResNet-50-FPN + improvements) |
| 3D | COCO minival | APS | 22.3 | FCOS (ResNet-50-FPN + improvements) |
| 3D | COCO minival | box AP | 38.6 | FCOS (ResNet-50-FPN + improvements) |
| 2D Classification | COCO test-dev | AP50 | 64.1 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Classification | COCO test-dev | AP75 | 48.4 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Classification | COCO test-dev | APL | 55.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Classification | COCO test-dev | APM | 47.5 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Classification | COCO test-dev | APS | 27.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Classification | COCO test-dev | box mAP | 44.7 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Classification | COCO test-dev | AP50 | 62.8 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Classification | COCO test-dev | AP75 | 46.6 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Classification | COCO test-dev | APL | 53.3 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Classification | COCO test-dev | APM | 46.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Classification | COCO test-dev | APS | 26.5 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Classification | COCO test-dev | box mAP | 43.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Classification | COCO test-dev | AP50 | 62.2 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Classification | COCO test-dev | AP75 | 46.1 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Classification | COCO test-dev | APL | 52.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Classification | COCO test-dev | APM | 45.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Classification | COCO test-dev | APS | 26 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Classification | COCO test-dev | box mAP | 42.7 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Classification | COCO test-dev | AP50 | 60.4 | FCOS (HRNet-W32-5l) |
| 2D Classification | COCO test-dev | AP75 | 45.3 | FCOS (HRNet-W32-5l) |
| 2D Classification | COCO test-dev | APL | 51 | FCOS (HRNet-W32-5l) |
| 2D Classification | COCO test-dev | APM | 45 | FCOS (HRNet-W32-5l) |
| 2D Classification | COCO test-dev | APS | 25.4 | FCOS (HRNet-W32-5l) |
| 2D Classification | COCO test-dev | box mAP | 42 | FCOS (HRNet-W32-5l) |
| 2D Classification | COCO-O | Average mAP | 16.7 | FCOS (ResNet-50) |
| 2D Classification | COCO-O | Effective Robustness | 0.25 | FCOS (ResNet-50) |
| 2D Classification | COCO minival | AP50 | 57.4 | FCOS (ResNet-50-FPN + improvements) |
| 2D Classification | COCO minival | AP75 | 41.4 | FCOS (ResNet-50-FPN + improvements) |
| 2D Classification | COCO minival | APL | 49.8 | FCOS (ResNet-50-FPN + improvements) |
| 2D Classification | COCO minival | APM | 42.5 | FCOS (ResNet-50-FPN + improvements) |
| 2D Classification | COCO minival | APS | 22.3 | FCOS (ResNet-50-FPN + improvements) |
| 2D Classification | COCO minival | box AP | 38.6 | FCOS (ResNet-50-FPN + improvements) |
| Pedestrian Detection | TJU-Ped-traffic | ALL (miss rate) | 40.02 | FCOS |
| Pedestrian Detection | TJU-Ped-traffic | HO (miss rate) | 63.73 | FCOS |
| Pedestrian Detection | TJU-Ped-traffic | R (miss rate) | 24.35 | FCOS |
| Pedestrian Detection | TJU-Ped-traffic | R+HO (miss rate) | 28.86 | FCOS |
| Pedestrian Detection | TJU-Ped-traffic | RS (miss rate) | 37.4 | FCOS |
| Pedestrian Detection | TJU-Ped-campus | ALL (miss rate) | 41.62 | FCOS |
| Pedestrian Detection | TJU-Ped-campus | HO (miss rate) | 81.28 | FCOS |
| Pedestrian Detection | TJU-Ped-campus | R (miss rate) | 31.89 | FCOS |
| Pedestrian Detection | TJU-Ped-campus | R+HO (miss rate) | 39.38 | FCOS |
| Pedestrian Detection | TJU-Ped-campus | RS (miss rate) | 69.04 | FCOS |
| 2D Object Detection | SARDet-100K | box mAP | 49.8 | FCOS |
| 2D Object Detection | COCO test-dev | AP50 | 64.1 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Object Detection | COCO test-dev | AP75 | 48.4 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Object Detection | COCO test-dev | APL | 55.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Object Detection | COCO test-dev | APM | 47.5 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Object Detection | COCO test-dev | APS | 27.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Object Detection | COCO test-dev | box mAP | 44.7 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 2D Object Detection | COCO test-dev | AP50 | 62.8 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Object Detection | COCO test-dev | AP75 | 46.6 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Object Detection | COCO test-dev | APL | 53.3 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Object Detection | COCO test-dev | APM | 46.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Object Detection | COCO test-dev | APS | 26.5 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Object Detection | COCO test-dev | box mAP | 43.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| 2D Object Detection | COCO test-dev | AP50 | 62.2 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Object Detection | COCO test-dev | AP75 | 46.1 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Object Detection | COCO test-dev | APL | 52.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Object Detection | COCO test-dev | APM | 45.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Object Detection | COCO test-dev | APS | 26 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Object Detection | COCO test-dev | box mAP | 42.7 | FCOS (ResNeXt-32x8d-101-FPN) |
| 2D Object Detection | COCO test-dev | AP50 | 60.4 | FCOS (HRNet-W32-5l) |
| 2D Object Detection | COCO test-dev | AP75 | 45.3 | FCOS (HRNet-W32-5l) |
| 2D Object Detection | COCO test-dev | APL | 51 | FCOS (HRNet-W32-5l) |
| 2D Object Detection | COCO test-dev | APM | 45 | FCOS (HRNet-W32-5l) |
| 2D Object Detection | COCO test-dev | APS | 25.4 | FCOS (HRNet-W32-5l) |
| 2D Object Detection | COCO test-dev | box mAP | 42 | FCOS (HRNet-W32-5l) |
| 2D Object Detection | COCO-O | Average mAP | 16.7 | FCOS (ResNet-50) |
| 2D Object Detection | COCO-O | Effective Robustness | 0.25 | FCOS (ResNet-50) |
| 2D Object Detection | COCO minival | AP50 | 57.4 | FCOS (ResNet-50-FPN + improvements) |
| 2D Object Detection | COCO minival | AP75 | 41.4 | FCOS (ResNet-50-FPN + improvements) |
| 2D Object Detection | COCO minival | APL | 49.8 | FCOS (ResNet-50-FPN + improvements) |
| 2D Object Detection | COCO minival | APM | 42.5 | FCOS (ResNet-50-FPN + improvements) |
| 2D Object Detection | COCO minival | APS | 22.3 | FCOS (ResNet-50-FPN + improvements) |
| 2D Object Detection | COCO minival | box AP | 38.6 | FCOS (ResNet-50-FPN + improvements) |
| 16k | COCO test-dev | AP50 | 64.1 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 16k | COCO test-dev | AP75 | 48.4 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 16k | COCO test-dev | APL | 55.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 16k | COCO test-dev | APM | 47.5 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 16k | COCO test-dev | APS | 27.6 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 16k | COCO test-dev | box mAP | 44.7 | FCOS (ResNeXt-64x4d-101-FPN 4 + improvements) |
| 16k | COCO test-dev | AP50 | 62.8 | FCOS (ResNeXt-101-64x4d-FPN) |
| 16k | COCO test-dev | AP75 | 46.6 | FCOS (ResNeXt-101-64x4d-FPN) |
| 16k | COCO test-dev | APL | 53.3 | FCOS (ResNeXt-101-64x4d-FPN) |
| 16k | COCO test-dev | APM | 46.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| 16k | COCO test-dev | APS | 26.5 | FCOS (ResNeXt-101-64x4d-FPN) |
| 16k | COCO test-dev | box mAP | 43.2 | FCOS (ResNeXt-101-64x4d-FPN) |
| 16k | COCO test-dev | AP50 | 62.2 | FCOS (ResNeXt-32x8d-101-FPN) |
| 16k | COCO test-dev | AP75 | 46.1 | FCOS (ResNeXt-32x8d-101-FPN) |
| 16k | COCO test-dev | APL | 52.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| 16k | COCO test-dev | APM | 45.6 | FCOS (ResNeXt-32x8d-101-FPN) |
| 16k | COCO test-dev | APS | 26 | FCOS (ResNeXt-32x8d-101-FPN) |
| 16k | COCO test-dev | box mAP | 42.7 | FCOS (ResNeXt-32x8d-101-FPN) |
| 16k | COCO test-dev | AP50 | 60.4 | FCOS (HRNet-W32-5l) |
| 16k | COCO test-dev | AP75 | 45.3 | FCOS (HRNet-W32-5l) |
| 16k | COCO test-dev | APL | 51 | FCOS (HRNet-W32-5l) |
| 16k | COCO test-dev | APM | 45 | FCOS (HRNet-W32-5l) |
| 16k | COCO test-dev | APS | 25.4 | FCOS (HRNet-W32-5l) |
| 16k | COCO test-dev | box mAP | 42 | FCOS (HRNet-W32-5l) |
| 16k | COCO-O | Average mAP | 16.7 | FCOS (ResNet-50) |
| 16k | COCO-O | Effective Robustness | 0.25 | FCOS (ResNet-50) |
| 16k | COCO minival | AP50 | 57.4 | FCOS (ResNet-50-FPN + improvements) |
| 16k | COCO minival | AP75 | 41.4 | FCOS (ResNet-50-FPN + improvements) |
| 16k | COCO minival | APL | 49.8 | FCOS (ResNet-50-FPN + improvements) |
| 16k | COCO minival | APM | 42.5 | FCOS (ResNet-50-FPN + improvements) |
| 16k | COCO minival | APS | 22.3 | FCOS (ResNet-50-FPN + improvements) |
| 16k | COCO minival | box AP | 38.6 | FCOS (ResNet-50-FPN + improvements) |