Metric: PQth (higher is better)
| # | Model↕ | PQth▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | OneFormer (ConvNeXt-L, single-scale, 512x1024, Mapillary Vistas-pretrained) | 64.6 | Yes | OneFormer: One Transformer to Rule Universal Ima... | 2022-11-10 | Code |
| 2 | EfficientPS | 63.2 | Yes | EfficientPS: Efficient Panoptic Segmentation | 2020-04-05 | Code |
| 3 | AFF-Base (single-scale, point-based Mask2Former) | 62.5 | No | AutoFocusFormer: Image Segmentation off the Grid | 2023-04-24 | Code |
| 4 | AFF-Small (single-scale, point-based Mask2Former) | 61.5 | No | AutoFocusFormer: Image Segmentation off the Grid | 2023-04-24 | Code |
| 5 | EfficientPS (Cityscapes-fine) | 61 | No | EfficientPS: Efficient Panoptic Segmentation | 2020-04-05 | Code |
| 6 | Panoptic FCN* (Swin-L, Cityscapes-fine) | 59.5 | No | Fully Convolutional Networks for Panoptic Segmen... | 2020-12-01 | Code |
| 7 | AdaptIS (ResNeXt-101) | 58.7 | No | AdaptIS: Adaptive Instance Selection Network | 2019-09-17 | - |
| 8 | UPSNet (ResNet-101, multiscale) | 57.6 | Yes | UPSNet: A Unified Panoptic Segmentation Network | 2019-01-12 | Code |
| 9 | AdaptIS (ResNet-101) | 57.5 | No | AdaptIS: Adaptive Instance Selection Network | 2019-09-17 | - |
| 10 | UPSNet (ResNet-101) | 57 | Yes | UPSNet: A Unified Panoptic Segmentation Network | 2019-01-12 | Code |
| 11 | TASCNet (ResNet-50, multi-scale) | 56.1 | Yes | Learning to Fuse Things and Stuff | 2018-12-04 | - |
| 12 | TASCNet (ResNet-50) | 56 | Yes | Learning to Fuse Things and Stuff | 2018-12-04 | - |
| 13 | AdaptIS (ResNet-50) | 55.8 | No | AdaptIS: Adaptive Instance Selection Network | 2019-09-17 | - |
| 14 | COPS (ResNet-50) | 55.1 | No | Combinatorial Optimization for Panoptic Segmenta... | 2021-06-06 | Code |
| 15 | Panoptic FCN* (ResNet-FPN) | 54.8 | No | Fully Convolutional Networks for Panoptic Segmen... | 2020-12-01 | Code |
| 16 | AUNet (ResNet-101-FPN) | 54.8 | No | Attention-guided Unified Network for Panoptic Se... | 2018-12-10 | - |
| 17 | Mask2Former + Intra-Batch Supervision (ResNet-50) | 54.7 | No | Intra-Batch Supervision for Panoptic Segmentatio... | 2023-04-17 | Code |
| 18 | UPSNet (ResNet-50) | 54.6 | No | UPSNet: A Unified Panoptic Segmentation Network | 2019-01-12 | Code |
| 19 | MRCNN + PSPNet (ResNet-101) | 54 | Yes | Panoptic Segmentation | 2018-01-03 | Code |
| 20 | Mask R-CNN+COCO | 54 | No | Mask R-CNN | 2017-03-20 | Code |
| 21 | Panoptic FPN (ResNet-101) | 52 | No | Panoptic Feature Pyramid Networks | 2019-01-08 | Code |
| 22 | Dynamically Instantiated Network (ResNet-101) | 42.5 | No | Weakly- and Semi-Supervised Panoptic Segmentation | 2018-08-10 | Code |