Yanbin Liu, Juho Lee, Minseop Park, Saehoon Kim, Eunho Yang, Sung Ju Hwang, Yi Yang
The goal of few-shot learning is to learn a classifier that generalizes well even when trained with a limited number of training instances per class. The recently introduced meta-learning approaches tackle this problem by learning a generic classifier across a large number of multiclass classification tasks and generalizing the model to a new task. Yet, even with such meta-learning, the low-data problem in the novel classification task still remains. In this paper, we propose Transductive Propagation Network (TPN), a novel meta-learning framework for transductive inference that classifies the entire test set at once to alleviate the low-data problem. Specifically, we propose to learn to propagate labels from labeled instances to unlabeled test instances, by learning a graph construction module that exploits the manifold structure in the data. TPN jointly learns both the parameters of feature embedding and the graph construction in an end-to-end manner. We validate TPN on multiple benchmark datasets, on which it largely outperforms existing few-shot learning approaches and achieves the state-of-the-art results.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Image Classification | Tiered ImageNet 10-way (1-shot) | Accuracy | 44.8 | TPN (Higher Shot) |
| Image Classification | Tiered ImageNet 10-way (1-shot) | Accuracy | 39.4 | Label Propagation |
| Image Classification | Mini-Imagenet 10-way (5-shot) | Accuracy | 52.8 | TPN (Higher Shot) |
| Image Classification | Mini-Imagenet 10-way (5-shot) | Accuracy | 51.2 | Label Propagation |
| Image Classification | Mini-Imagenet 10-way (1-shot) | Accuracy | 38.4 | TPN (Higher Shot) |
| Image Classification | Mini-Imagenet 10-way (1-shot) | Accuracy | 35.2 | Label Propagation |
| Image Classification | Tiered ImageNet 10-way (5-shot) | Accuracy | 59.4 | TPN (Higher Shot) |
| Image Classification | Tiered ImageNet 10-way (5-shot) | Accuracy | 57.9 | Label Propagation |
| Few-Shot Image Classification | Tiered ImageNet 10-way (1-shot) | Accuracy | 44.8 | TPN (Higher Shot) |
| Few-Shot Image Classification | Tiered ImageNet 10-way (1-shot) | Accuracy | 39.4 | Label Propagation |
| Few-Shot Image Classification | Mini-Imagenet 10-way (5-shot) | Accuracy | 52.8 | TPN (Higher Shot) |
| Few-Shot Image Classification | Mini-Imagenet 10-way (5-shot) | Accuracy | 51.2 | Label Propagation |
| Few-Shot Image Classification | Mini-Imagenet 10-way (1-shot) | Accuracy | 38.4 | TPN (Higher Shot) |
| Few-Shot Image Classification | Mini-Imagenet 10-way (1-shot) | Accuracy | 35.2 | Label Propagation |
| Few-Shot Image Classification | Tiered ImageNet 10-way (5-shot) | Accuracy | 59.4 | TPN (Higher Shot) |
| Few-Shot Image Classification | Tiered ImageNet 10-way (5-shot) | Accuracy | 57.9 | Label Propagation |