Hei Law, Jia Deng
We propose CornerNet, a new approach to object detection where we detect an object bounding box as a pair of keypoints, the top-left corner and the bottom-right corner, using a single convolution neural network. By detecting objects as paired keypoints, we eliminate the need for designing a set of anchor boxes commonly used in prior single-stage detectors. In addition to our novel formulation, we introduce corner pooling, a new type of pooling layer that helps the network better localize corners. Experiments show that CornerNet achieves a 42.2% AP on MS COCO, outperforming all existing one-stage detectors.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Object Detection | COCO test-dev | AP50 | 57.8 | CornerNet511 (Hourglass-104, multi-scale) |
| Object Detection | COCO test-dev | AP75 | 45.3 | CornerNet511 (Hourglass-104, multi-scale) |
| Object Detection | COCO test-dev | APL | 56.7 | CornerNet511 (Hourglass-104, multi-scale) |
| Object Detection | COCO test-dev | APM | 44.8 | CornerNet511 (Hourglass-104, multi-scale) |
| Object Detection | COCO test-dev | APS | 20.8 | CornerNet511 (Hourglass-104, multi-scale) |
| Object Detection | COCO test-dev | box mAP | 42.1 | CornerNet511 (Hourglass-104, multi-scale) |
| Object Detection | COCO test-dev | AP50 | 53.7 | CornerNet511 (Hourglass-52, single-scale) |
| Object Detection | COCO test-dev | AP75 | 40.1 | CornerNet511 (Hourglass-52, single-scale) |
| Object Detection | COCO test-dev | APL | 50.5 | CornerNet511 (Hourglass-52, single-scale) |
| Object Detection | COCO test-dev | APM | 39 | CornerNet511 (Hourglass-52, single-scale) |
| Object Detection | COCO test-dev | APS | 17 | CornerNet511 (Hourglass-52, single-scale) |
| Object Detection | COCO test-dev | box mAP | 37.8 | CornerNet511 (Hourglass-52, single-scale) |
| Object Detection | COCO minival | AP50 | 53.8 | CornerNet511 (Hourglass-104) |
| Object Detection | COCO minival | AP75 | 40.9 | CornerNet511 (Hourglass-104) |
| Object Detection | COCO minival | APL | 51.8 | CornerNet511 (Hourglass-104) |
| Object Detection | COCO minival | APM | 40.5 | CornerNet511 (Hourglass-104) |
| Object Detection | COCO minival | APS | 18.6 | CornerNet511 (Hourglass-104) |
| Object Detection | COCO minival | box AP | 38.4 | CornerNet511 (Hourglass-104) |
| 3D | COCO test-dev | AP50 | 57.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 3D | COCO test-dev | AP75 | 45.3 | CornerNet511 (Hourglass-104, multi-scale) |
| 3D | COCO test-dev | APL | 56.7 | CornerNet511 (Hourglass-104, multi-scale) |
| 3D | COCO test-dev | APM | 44.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 3D | COCO test-dev | APS | 20.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 3D | COCO test-dev | box mAP | 42.1 | CornerNet511 (Hourglass-104, multi-scale) |
| 3D | COCO test-dev | AP50 | 53.7 | CornerNet511 (Hourglass-52, single-scale) |
| 3D | COCO test-dev | AP75 | 40.1 | CornerNet511 (Hourglass-52, single-scale) |
| 3D | COCO test-dev | APL | 50.5 | CornerNet511 (Hourglass-52, single-scale) |
| 3D | COCO test-dev | APM | 39 | CornerNet511 (Hourglass-52, single-scale) |
| 3D | COCO test-dev | APS | 17 | CornerNet511 (Hourglass-52, single-scale) |
| 3D | COCO test-dev | box mAP | 37.8 | CornerNet511 (Hourglass-52, single-scale) |
| 3D | COCO minival | AP50 | 53.8 | CornerNet511 (Hourglass-104) |
| 3D | COCO minival | AP75 | 40.9 | CornerNet511 (Hourglass-104) |
| 3D | COCO minival | APL | 51.8 | CornerNet511 (Hourglass-104) |
| 3D | COCO minival | APM | 40.5 | CornerNet511 (Hourglass-104) |
| 3D | COCO minival | APS | 18.6 | CornerNet511 (Hourglass-104) |
| 3D | COCO minival | box AP | 38.4 | CornerNet511 (Hourglass-104) |
| 2D Classification | COCO test-dev | AP50 | 57.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Classification | COCO test-dev | AP75 | 45.3 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Classification | COCO test-dev | APL | 56.7 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Classification | COCO test-dev | APM | 44.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Classification | COCO test-dev | APS | 20.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Classification | COCO test-dev | box mAP | 42.1 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Classification | COCO test-dev | AP50 | 53.7 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Classification | COCO test-dev | AP75 | 40.1 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Classification | COCO test-dev | APL | 50.5 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Classification | COCO test-dev | APM | 39 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Classification | COCO test-dev | APS | 17 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Classification | COCO test-dev | box mAP | 37.8 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Classification | COCO minival | AP50 | 53.8 | CornerNet511 (Hourglass-104) |
| 2D Classification | COCO minival | AP75 | 40.9 | CornerNet511 (Hourglass-104) |
| 2D Classification | COCO minival | APL | 51.8 | CornerNet511 (Hourglass-104) |
| 2D Classification | COCO minival | APM | 40.5 | CornerNet511 (Hourglass-104) |
| 2D Classification | COCO minival | APS | 18.6 | CornerNet511 (Hourglass-104) |
| 2D Classification | COCO minival | box AP | 38.4 | CornerNet511 (Hourglass-104) |
| 2D Object Detection | COCO test-dev | AP50 | 57.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Object Detection | COCO test-dev | AP75 | 45.3 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Object Detection | COCO test-dev | APL | 56.7 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Object Detection | COCO test-dev | APM | 44.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Object Detection | COCO test-dev | APS | 20.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Object Detection | COCO test-dev | box mAP | 42.1 | CornerNet511 (Hourglass-104, multi-scale) |
| 2D Object Detection | COCO test-dev | AP50 | 53.7 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Object Detection | COCO test-dev | AP75 | 40.1 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Object Detection | COCO test-dev | APL | 50.5 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Object Detection | COCO test-dev | APM | 39 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Object Detection | COCO test-dev | APS | 17 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Object Detection | COCO test-dev | box mAP | 37.8 | CornerNet511 (Hourglass-52, single-scale) |
| 2D Object Detection | COCO minival | AP50 | 53.8 | CornerNet511 (Hourglass-104) |
| 2D Object Detection | COCO minival | AP75 | 40.9 | CornerNet511 (Hourglass-104) |
| 2D Object Detection | COCO minival | APL | 51.8 | CornerNet511 (Hourglass-104) |
| 2D Object Detection | COCO minival | APM | 40.5 | CornerNet511 (Hourglass-104) |
| 2D Object Detection | COCO minival | APS | 18.6 | CornerNet511 (Hourglass-104) |
| 2D Object Detection | COCO minival | box AP | 38.4 | CornerNet511 (Hourglass-104) |
| 16k | COCO test-dev | AP50 | 57.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 16k | COCO test-dev | AP75 | 45.3 | CornerNet511 (Hourglass-104, multi-scale) |
| 16k | COCO test-dev | APL | 56.7 | CornerNet511 (Hourglass-104, multi-scale) |
| 16k | COCO test-dev | APM | 44.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 16k | COCO test-dev | APS | 20.8 | CornerNet511 (Hourglass-104, multi-scale) |
| 16k | COCO test-dev | box mAP | 42.1 | CornerNet511 (Hourglass-104, multi-scale) |
| 16k | COCO test-dev | AP50 | 53.7 | CornerNet511 (Hourglass-52, single-scale) |
| 16k | COCO test-dev | AP75 | 40.1 | CornerNet511 (Hourglass-52, single-scale) |
| 16k | COCO test-dev | APL | 50.5 | CornerNet511 (Hourglass-52, single-scale) |
| 16k | COCO test-dev | APM | 39 | CornerNet511 (Hourglass-52, single-scale) |
| 16k | COCO test-dev | APS | 17 | CornerNet511 (Hourglass-52, single-scale) |
| 16k | COCO test-dev | box mAP | 37.8 | CornerNet511 (Hourglass-52, single-scale) |
| 16k | COCO minival | AP50 | 53.8 | CornerNet511 (Hourglass-104) |
| 16k | COCO minival | AP75 | 40.9 | CornerNet511 (Hourglass-104) |
| 16k | COCO minival | APL | 51.8 | CornerNet511 (Hourglass-104) |
| 16k | COCO minival | APM | 40.5 | CornerNet511 (Hourglass-104) |
| 16k | COCO minival | APS | 18.6 | CornerNet511 (Hourglass-104) |
| 16k | COCO minival | box AP | 38.4 | CornerNet511 (Hourglass-104) |