Xiang Jiang, Qicheng Lao, Stan Matwin, Mohammad Havaei
We present an approach for unsupervised domain adaptation---with a strong focus on practical considerations of within-domain class imbalance and between-domain class distribution shift---from a class-conditioned domain alignment perspective. Current methods for class-conditioned domain alignment aim to explicitly minimize a loss function based on pseudo-label estimations of the target domain. However, these methods suffer from pseudo-label bias in the form of error accumulation. We propose a method that removes the need for explicit optimization of model parameters from pseudo-labels directly. Instead, we present a sampling-based implicit alignment approach, where the sample selection procedure is implicitly guided by the pseudo-labels. Theoretical analysis reveals the existence of a domain-discriminator shortcut in misaligned classes, which is addressed by the proposed implicit alignment approach to facilitate domain-adversarial learning. Empirical results and ablation studies confirm the effectiveness of the proposed approach, especially in the presence of within-domain class imbalance and between-domain class distribution shift.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 61.67 | Implicit Alignment (with MDD) |
| Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 58.4 | COAL |
| Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 56.91 | DANN |
| Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 55.44 | MDD |
| Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 52.81 | Source Only |
| Domain Adaptation | VisDA2017 | Accuracy | 75.8 | Implicit Alignment (with MDD) |
| Domain Adaptation | Office-Home | Avg accuracy | 69.5 | Implicit Alignment (with MDD) |
| Domain Adaptation | Office-31 | Avg accuracy | 88.8 | Implicit Alignment (with MDD) |
| Unsupervised Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 61.67 | Implicit Alignment (with MDD) |
| Unsupervised Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 58.4 | COAL |
| Unsupervised Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 56.91 | DANN |
| Unsupervised Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 55.44 | MDD |
| Unsupervised Domain Adaptation | Office-Home (RS-UT imbalance) | Average Per-Class Accuracy | 52.81 | Source Only |
| Unsupervised Domain Adaptation | VisDA2017 | Accuracy | 75.8 | Implicit Alignment (with MDD) |
| Unsupervised Domain Adaptation | Office-Home | Avg accuracy | 69.5 | Implicit Alignment (with MDD) |
| Unsupervised Domain Adaptation | Office-31 | Avg accuracy | 88.8 | Implicit Alignment (with MDD) |