Atsuro Okazawa
Traditional semantic segmentation requires a large labeled image dataset and can only be predicted within predefined classes. To solve this problem, few-shot segmentation, which requires only a handful of annotations for the new target class, is important. However, with few-shot segmentation, the target class data distribution in the feature space is sparse and has low coverage because of the slight variations in the sample data. Setting the classification boundary that properly separates the target class from other classes is an impossible task. In particular, it is difficult to classify classes that are similar to the target class near the boundary. This study proposes the Interclass Prototype Relation Network (IPRNet), which improves the separation performance by reducing the similarity between other classes. We conducted extensive experiments with Pascal-5i and COCO-20i and showed that IPRNet provides the best segmentation performance compared with previous research.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Few-Shot Learning | COCO-20i (5-shot) | Mean IoU | 53.3 | IPRNet (ResNet-101) |
| Few-Shot Learning | COCO-20i (5-shot) | Mean IoU | 51.1 | IPRNet (ResNet-50) |
| Few-Shot Learning | PASCAL-5i (1-Shot) | Mean IoU | 67.5 | IPRNet (ResNet-101) |
| Few-Shot Learning | PASCAL-5i (1-Shot) | Mean IoU | 65.7 | IPRNet (ResNet-50) |
| Few-Shot Learning | COCO-20i (1-shot) | Mean IoU | 46.9 | IPRNet (ResNet-101) |
| Few-Shot Learning | COCO-20i (1-shot) | Mean IoU | 45.3 | IPRNet (ResNet-50) |
| Few-Shot Learning | PASCAL-5i (5-Shot) | Mean IoU | 70.9 | IPRNet (ResNet-101) |
| Few-Shot Learning | PASCAL-5i (5-Shot) | Mean IoU | 70.2 | IPRNet (ResNet-50) |
| Few-Shot Semantic Segmentation | COCO-20i (5-shot) | Mean IoU | 53.3 | IPRNet (ResNet-101) |
| Few-Shot Semantic Segmentation | COCO-20i (5-shot) | Mean IoU | 51.1 | IPRNet (ResNet-50) |
| Few-Shot Semantic Segmentation | PASCAL-5i (1-Shot) | Mean IoU | 67.5 | IPRNet (ResNet-101) |
| Few-Shot Semantic Segmentation | PASCAL-5i (1-Shot) | Mean IoU | 65.7 | IPRNet (ResNet-50) |
| Few-Shot Semantic Segmentation | COCO-20i (1-shot) | Mean IoU | 46.9 | IPRNet (ResNet-101) |
| Few-Shot Semantic Segmentation | COCO-20i (1-shot) | Mean IoU | 45.3 | IPRNet (ResNet-50) |
| Few-Shot Semantic Segmentation | PASCAL-5i (5-Shot) | Mean IoU | 70.9 | IPRNet (ResNet-101) |
| Few-Shot Semantic Segmentation | PASCAL-5i (5-Shot) | Mean IoU | 70.2 | IPRNet (ResNet-50) |
| Meta-Learning | COCO-20i (5-shot) | Mean IoU | 53.3 | IPRNet (ResNet-101) |
| Meta-Learning | COCO-20i (5-shot) | Mean IoU | 51.1 | IPRNet (ResNet-50) |
| Meta-Learning | PASCAL-5i (1-Shot) | Mean IoU | 67.5 | IPRNet (ResNet-101) |
| Meta-Learning | PASCAL-5i (1-Shot) | Mean IoU | 65.7 | IPRNet (ResNet-50) |
| Meta-Learning | COCO-20i (1-shot) | Mean IoU | 46.9 | IPRNet (ResNet-101) |
| Meta-Learning | COCO-20i (1-shot) | Mean IoU | 45.3 | IPRNet (ResNet-50) |
| Meta-Learning | PASCAL-5i (5-Shot) | Mean IoU | 70.9 | IPRNet (ResNet-101) |
| Meta-Learning | PASCAL-5i (5-Shot) | Mean IoU | 70.2 | IPRNet (ResNet-50) |