Timur Mamedov, Anton Konushin, Vadim Konushin
Modern person re-identification (Re-ID) methods have a weak generalization ability and experience a major accuracy drop when capturing environments change. This is because existing multi-camera Re-ID datasets are limited in size and diversity, since such data is difficult to obtain. At the same time, enormous volumes of unlabeled single-camera records are available. Such data can be easily collected, and therefore, it is more diverse. Currently, single-camera data is used only for self-supervised pre-training of Re-ID methods. However, the diversity of single-camera data is suppressed by fine-tuning on limited multi-camera data after pre-training. In this paper, we propose ReMix, a generalized Re-ID method jointly trained on a mixture of limited labeled multi-camera and large unlabeled single-camera data. Effective training of our method is achieved through a novel data sampling strategy and new loss functions that are adapted for joint use with both types of data. Experiments show that ReMix has a high generalization ability and outperforms state-of-the-art methods in generalizable person Re-ID. To the best of our knowledge, this is the first work that explores joint training on a mixture of multi-camera and single-camera data in person Re-ID.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Person Re-Identification | MSMT17 | Rank-1 | 84.8 | ReMix |
| Person Re-Identification | MSMT17 | mAP | 63.9 | ReMix |
| Person Re-Identification | Market-1501 | Rank-1 | 96.2 | ReMix |
| Person Re-Identification | Market-1501 | mAP | 89.8 | ReMix |
| Person Re-Identification | DukeMTMC-reID | Rank-1 | 89.6 | ReMix |
| Person Re-Identification | DukeMTMC-reID | mAP | 79.8 | ReMix |
| Person Re-Identification | DukeMTMC-reID | MSMT17->Rank1 | 71.6 | ReMix |
| Person Re-Identification | DukeMTMC-reID | MSMT17->mAP | 52.8 | ReMix |
| Person Re-Identification | DukeMTMC-reID | MSMT17-All->Rank-1 | 77.6 | ReMix |
| Person Re-Identification | DukeMTMC-reID | MSMT17-All->mAP | 61.6 | ReMix |
| Person Re-Identification | DukeMTMC-reID | Market-1501->Rank1 | 58.4 | ReMix |
| Person Re-Identification | DukeMTMC-reID | Market-1501->mAP | 38.8 | ReMix |
| Person Re-Identification | DukeMTMC-reID | RandPerson->Rank1 | 63.2 | ReMix |
| Person Re-Identification | DukeMTMC-reID | RandPerson->mAP | 42.8 | ReMix |
| Person Re-Identification | CUHK03-NP (detected) | MSMT17->Rank-1 | 27.3 | ReMix |
| Person Re-Identification | CUHK03-NP (detected) | MSMT17->mAP | 27.4 | ReMix |
| Person Re-Identification | CUHK03-NP (detected) | MSMT17-All->Rank-1 | 37.7 | ReMix |
| Person Re-Identification | CUHK03-NP (detected) | MSMT17-All->mAP | 37.2 | ReMix |
| Person Re-Identification | CUHK03-NP (detected) | RandPerson->Rank-1 | 19.3 | ReMix |
| Person Re-Identification | CUHK03-NP (detected) | RandPerson->mAP | 18.4 | ReMix |
| Person Re-Identification | Market-1501 | DukeMTMC-reID->Rank1 | 71.3 | ReMix |
| Person Re-Identification | Market-1501 | DukeMTMC-reID->mAP | 43 | ReMix |
| Person Re-Identification | Market-1501 | MSMT17->Rank-1 | 78.2 | ReMix |
| Person Re-Identification | Market-1501 | MSMT17->mAP | 52.4 | ReMix |
| Person Re-Identification | Market-1501 | MSMT17-All->Rank-1 | 84 | ReMix |
| Person Re-Identification | Market-1501 | MSMT17-All->mAP | 61 | ReMix |
| Person Re-Identification | Market-1501 | RandPerson->Rank-1 | 72.7 | ReMix |
| Person Re-Identification | Market-1501 | RandPerson->mAP | 45.4 | ReMix |