Peyman Bateni, Jarred Barber, Jan-Willem van de Meent, Frank Wood
We develop a transductive meta-learning method that uses unlabelled instances to improve few-shot image classification performance. Our approach combines a regularized Mahalanobis-distance-based soft k-means clustering procedure with a modified state of the art neural adaptive feature extractor to achieve improved test-time classification accuracy using unlabelled data. We evaluate our method on transductive few-shot learning tasks, in which the goal is to jointly predict labels for query (test) examples given a set of support (training) examples. We achieve state of the art performance on the Meta-Dataset, mini-ImageNet and tiered-ImageNet benchmarks. All trained models and code have been made publicly available at github.com/plai-group/simple-cnaps.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Image Classification | Meta-Dataset | Accuracy | 70.32 | Transductive CNAPS |
| Image Classification | Tiered ImageNet 10-way (1-shot) | Accuracy | 65.1 | Transductive CNAPS + FETI |
| Image Classification | Tiered ImageNet 10-way (1-shot) | Accuracy | 54.6 | Transductive CNAPS |
| Image Classification | Mini-Imagenet 10-way (5-shot) | Accuracy | 85.9 | Transductive CNAPS + FETI |
| Image Classification | Mini-Imagenet 10-way (5-shot) | Accuracy | 59.6 | Transductive CNAPS |
| Image Classification | Mini-Imagenet 5-way (5-shot) | Accuracy | 91.5 | Transductive CNAPS + FETI |
| Image Classification | Mini-Imagenet 5-way (5-shot) | Accuracy | 73.1 | Transductive CNAPS |
| Image Classification | Mini-Imagenet 5-way (1-shot) | Accuracy | 79.9 | Transductive CNAPS + FETI |
| Image Classification | Mini-Imagenet 5-way (1-shot) | Accuracy | 55.6 | Transductive CNAPS |
| Image Classification | Mini-Imagenet 10-way (1-shot) | Accuracy | 68.5 | Transductive CNAPS + FETI |
| Image Classification | Mini-Imagenet 10-way (1-shot) | Accuracy | 42.8 | Transductive CNAPS |
| Image Classification | Meta-Dataset Rank | Mean Rank | 3.05 | Transductive CNAPS |
| Image Classification | Tiered ImageNet 10-way (5-shot) | Accuracy | 80.6 | Transductive CNAPS + FETI |
| Image Classification | Tiered ImageNet 10-way (5-shot) | Accuracy | 72.5 | Transductive CNAPS |
| Image Classification | Tiered ImageNet 5-way (1-shot) | Accuracy | 73.8 | Transductive CNAPS + FETI |
| Image Classification | Tiered ImageNet 5-way (1-shot) | Accuracy | 65.9 | Transductive CNAPS |
| Image Classification | Tiered ImageNet 5-way (5-shot) | Accuracy | 87.7 | Transductive CNAPS + FETI |
| Image Classification | Tiered ImageNet 5-way (5-shot) | Accuracy | 81.8 | Transductive CNAPS |
| Few-Shot Image Classification | Meta-Dataset | Accuracy | 70.32 | Transductive CNAPS |
| Few-Shot Image Classification | Tiered ImageNet 10-way (1-shot) | Accuracy | 65.1 | Transductive CNAPS + FETI |
| Few-Shot Image Classification | Tiered ImageNet 10-way (1-shot) | Accuracy | 54.6 | Transductive CNAPS |
| Few-Shot Image Classification | Mini-Imagenet 10-way (5-shot) | Accuracy | 85.9 | Transductive CNAPS + FETI |
| Few-Shot Image Classification | Mini-Imagenet 10-way (5-shot) | Accuracy | 59.6 | Transductive CNAPS |
| Few-Shot Image Classification | Mini-Imagenet 5-way (5-shot) | Accuracy | 91.5 | Transductive CNAPS + FETI |
| Few-Shot Image Classification | Mini-Imagenet 5-way (5-shot) | Accuracy | 73.1 | Transductive CNAPS |
| Few-Shot Image Classification | Mini-Imagenet 5-way (1-shot) | Accuracy | 79.9 | Transductive CNAPS + FETI |
| Few-Shot Image Classification | Mini-Imagenet 5-way (1-shot) | Accuracy | 55.6 | Transductive CNAPS |
| Few-Shot Image Classification | Mini-Imagenet 10-way (1-shot) | Accuracy | 68.5 | Transductive CNAPS + FETI |
| Few-Shot Image Classification | Mini-Imagenet 10-way (1-shot) | Accuracy | 42.8 | Transductive CNAPS |
| Few-Shot Image Classification | Meta-Dataset Rank | Mean Rank | 3.05 | Transductive CNAPS |
| Few-Shot Image Classification | Tiered ImageNet 10-way (5-shot) | Accuracy | 80.6 | Transductive CNAPS + FETI |
| Few-Shot Image Classification | Tiered ImageNet 10-way (5-shot) | Accuracy | 72.5 | Transductive CNAPS |
| Few-Shot Image Classification | Tiered ImageNet 5-way (1-shot) | Accuracy | 73.8 | Transductive CNAPS + FETI |
| Few-Shot Image Classification | Tiered ImageNet 5-way (1-shot) | Accuracy | 65.9 | Transductive CNAPS |
| Few-Shot Image Classification | Tiered ImageNet 5-way (5-shot) | Accuracy | 87.7 | Transductive CNAPS + FETI |
| Few-Shot Image Classification | Tiered ImageNet 5-way (5-shot) | Accuracy | 81.8 | Transductive CNAPS |