Metric: PQst (higher is better)
| # | Model↕ | PQst▼ | Extra Data | Paper | Date↕ | Code |
|---|---|---|---|---|---|---|
| 1 | OneFormer (ConvNeXt-L, single-scale, 512x1024, Mapillary Vistas-pretrained) | 74.1 | Yes | OneFormer: One Transformer to Rule Universal Ima... | 2022-11-10 | Code |
| 2 | AFF-Base (single-scale, point-based Mask2Former) | 71.5 | No | AutoFocusFormer: Image Segmentation off the Grid | 2023-04-24 | Code |
| 3 | AFF-Small (single-scale, point-based Mask2Former) | 70.8 | No | AutoFocusFormer: Image Segmentation off the Grid | 2023-04-24 | Code |
| 4 | Panoptic FCN* (Swin-L, Cityscapes-fine) | 70.6 | No | Fully Convolutional Networks for Panoptic Segmen... | 2020-12-01 | Code |
| 5 | EfficientPS | 70.3 | Yes | EfficientPS: Efficient Panoptic Segmentation | 2020-04-05 | Code |
| 6 | EfficientPS (Cityscapes-fine) | 67.7 | No | EfficientPS: Efficient Panoptic Segmentation | 2020-04-05 | Code |
| 7 | Mask2Former + Intra-Batch Supervision (ResNet-50) | 67.3 | No | Intra-Batch Supervision for Panoptic Segmentatio... | 2023-04-17 | Code |
| 8 | COPS (ResNet-50) | 67.2 | No | Combinatorial Optimization for Panoptic Segmenta... | 2021-06-06 | Code |
| 9 | Panoptic FCN* (ResNet-50-FPN) | 66.6 | No | Fully Convolutional Networks for Panoptic Segmen... | 2020-12-01 | Code |
| 10 | MRCNN + PSPNet (ResNet-101) | 66.4 | Yes | Panoptic Segmentation | 2018-01-03 | Code |
| 11 | UPSNet (ResNet-101, multiscale) | 64.8 | Yes | UPSNet: A Unified Panoptic Segmentation Network | 2019-01-12 | Code |
| 12 | AdaptIS (ResNeXt-101) | 64.4 | No | AdaptIS: Adaptive Instance Selection Network | 2019-09-17 | - |
| 13 | TASCNet (ResNet-50, multi-scale) | 63.3 | Yes | Learning to Fuse Things and Stuff | 2018-12-04 | - |
| 14 | UPSNet (ResNet-101) | 63 | Yes | UPSNet: A Unified Panoptic Segmentation Network | 2019-01-12 | Code |
| 15 | AdaptIS (ResNet-101) | 62.9 | No | AdaptIS: Adaptive Instance Selection Network | 2019-09-17 | - |
| 16 | UPSNet (ResNet-50) | 62.7 | No | UPSNet: A Unified Panoptic Segmentation Network | 2019-01-12 | Code |
| 17 | Panoptic FPN (ResNet-101) | 62.5 | No | Panoptic Feature Pyramid Networks | 2019-01-08 | Code |
| 18 | AUNet (ResNet-101-FPN) | 62.1 | No | Attention-guided Unified Network for Panoptic Se... | 2018-12-10 | - |
| 19 | Dynamically Instantiated Network (ResNet-101) | 62.1 | No | Weakly- and Semi-Supervised Panoptic Segmentation | 2018-08-10 | Code |
| 20 | TASCNet (ResNet-50) | 61.5 | Yes | Learning to Fuse Things and Stuff | 2018-12-04 | - |
| 21 | AdaptIS (ResNet-50) | 61.3 | No | AdaptIS: Adaptive Instance Selection Network | 2019-09-17 | - |