Yuqing Hu, Vincent Gripon, Stéphane Pateux
Few-shot classification is a challenging problem due to the uncertainty caused by using few labelled samples. In the past few years, many methods have been proposed to solve few-shot classification, among which transfer-based methods have proved to achieve the best performance. Following this vein, in this paper we propose a novel transfer-based method that builds on two successive steps: 1) preprocessing the feature vectors so that they become closer to Gaussian-like distributions, and 2) leveraging this preprocessing using an optimal-transport inspired algorithm (in the case of transductive settings). Using standardized vision benchmarks, we prove the ability of the proposed methodology to achieve state-of-the-art accuracy with various datasets, backbone architectures and few-shot settings.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Image Classification | CUB 200 5-way 5-shot | Accuracy | 93.99 | PT+MAP |
| Image Classification | Dirichlet Mini-Imagenet (5-way, 5-shot) | 1:1 Accuracy | 67.1 | PT-MAP |
| Image Classification | Mini-ImageNet-CUB 5-way (5-shot) | Accuracy | 76.51 | PT+MAP |
| Image Classification | CIFAR-FS 5-way (1-shot) | Accuracy | 87.69 | PT+MAP |
| Image Classification | Dirichlet Tiered-Imagenet (5-way, 5-shot) | 1:1 Accuracy | 70 | PT-MAP |
| Image Classification | Mini-ImageNet-CUB 5-way (1-shot) | Accuracy | 62.49 | PT+MAP |
| Image Classification | Mini-Imagenet 5-way (5-shot) | Accuracy | 88.82 | PT+MAP |
| Image Classification | Dirichlet CUB-200 (5-way, 1-shot) | 1:1 Accuracy | 65.1 | PT-MAP |
| Image Classification | Dirichlet Mini-Imagenet (5-way, 1-shot) | 1:1 Accuracy | 60.6 | PT-MAP |
| Image Classification | Mini-Imagenet 5-way (1-shot) | Accuracy | 82.92 | PT+MAP (transductive) |
| Image Classification | Dirichlet CUB-200 (5-way, 5-shot) | 1:1 Accuracy | 71.3 | PT-MAP |
| Image Classification | Dirichlet Tiered-Imagenet (5-way, 1-shot) | 1:1 Accuracy | 64.1 | PT-MAP |
| Image Classification | Mini-Imagenet 5-way (10-shot) | Accuracy | 90.03 | PT+MAP |
| Image Classification | Tiered ImageNet 5-way (1-shot) | Accuracy | 85.41 | PT+MAP |
| Image Classification | Tiered ImageNet 5-way (5-shot) | Accuracy | 90.44 | PT+MAP |
| Image Classification | CIFAR-FS 5-way (5-shot) | Accuracy | 90.68 | PT+MAP |
| Few-Shot Image Classification | CUB 200 5-way 5-shot | Accuracy | 93.99 | PT+MAP |
| Few-Shot Image Classification | Dirichlet Mini-Imagenet (5-way, 5-shot) | 1:1 Accuracy | 67.1 | PT-MAP |
| Few-Shot Image Classification | Mini-ImageNet-CUB 5-way (5-shot) | Accuracy | 76.51 | PT+MAP |
| Few-Shot Image Classification | CIFAR-FS 5-way (1-shot) | Accuracy | 87.69 | PT+MAP |
| Few-Shot Image Classification | Dirichlet Tiered-Imagenet (5-way, 5-shot) | 1:1 Accuracy | 70 | PT-MAP |
| Few-Shot Image Classification | Mini-ImageNet-CUB 5-way (1-shot) | Accuracy | 62.49 | PT+MAP |
| Few-Shot Image Classification | Mini-Imagenet 5-way (5-shot) | Accuracy | 88.82 | PT+MAP |
| Few-Shot Image Classification | Dirichlet CUB-200 (5-way, 1-shot) | 1:1 Accuracy | 65.1 | PT-MAP |
| Few-Shot Image Classification | Dirichlet Mini-Imagenet (5-way, 1-shot) | 1:1 Accuracy | 60.6 | PT-MAP |
| Few-Shot Image Classification | Mini-Imagenet 5-way (1-shot) | Accuracy | 82.92 | PT+MAP (transductive) |
| Few-Shot Image Classification | Dirichlet CUB-200 (5-way, 5-shot) | 1:1 Accuracy | 71.3 | PT-MAP |
| Few-Shot Image Classification | Dirichlet Tiered-Imagenet (5-way, 1-shot) | 1:1 Accuracy | 64.1 | PT-MAP |
| Few-Shot Image Classification | Mini-Imagenet 5-way (10-shot) | Accuracy | 90.03 | PT+MAP |
| Few-Shot Image Classification | Tiered ImageNet 5-way (1-shot) | Accuracy | 85.41 | PT+MAP |
| Few-Shot Image Classification | Tiered ImageNet 5-way (5-shot) | Accuracy | 90.44 | PT+MAP |
| Few-Shot Image Classification | CIFAR-FS 5-way (5-shot) | Accuracy | 90.68 | PT+MAP |