Zhaorui Tan, Xi Yang, Kaizhu Huang
Multi-domain generalization (mDG) is universally aimed to minimize the discrepancy between training and testing distributions to enhance marginal-to-label distribution mapping. However, existing mDG literature lacks a general learning objective paradigm and often imposes constraints on static target marginal distributions. In this paper, we propose to leverage a $Y$-mapping to relax the constraint. We rethink the learning objective for mDG and design a new \textbf{general learning objective} to interpret and analyze most existing mDG wisdom. This general objective is bifurcated into two synergistic amis: learning domain-independent conditional features and maximizing a posterior. Explorations also extend to two effective regularization terms that incorporate prior information and suppress invalid causality, alleviating the issues that come with relaxed constraints. We theoretically contribute an upper bound for the domain alignment of domain-independent conditional features, disclosing that many previous mDG endeavors actually \textbf{optimize partially the objective} and thus lead to limited performance. As such, our study distills a general learning objective into four practical components, providing a general, robust, and flexible mechanism to handle complex domain shifts. Extensive empirical results indicate that the proposed objective with $Y$-mapping leads to substantially better mDG performance in various downstream tasks, including regression, segmentation, and classification.
| Task | Dataset | Metric | Value | Model |
|---|---|---|---|---|
| Domain Adaptation | PACS | Average Accuracy | 97.9 | GMDG (RegNetY-16GF, SWAD) |
| Domain Adaptation | PACS | Average Accuracy | 97.3 | GMDG (e RegNetY-16GF) |
| Domain Adaptation | PACS | Average Accuracy | 88.4 | GMDG (ResNet-50, SWAD) |
| Domain Adaptation | PACS | Average Accuracy | 85.6 | GMDG (ResNet-50) |
| Domain Adaptation | Office-Home | Average Accuracy | 84.7 | GMDG (RegNetY-16GF, SWAD) |
| Domain Adaptation | Office-Home | Average Accuracy | 80.8 | GMDG (RegNetY-16GF) |
| Domain Adaptation | Office-Home | Average Accuracy | 72.5 | GMDG (ResNet-50, SWAD) |
| Domain Adaptation | Office-Home | Average Accuracy | 70.7 | GMDG (ResNet-50) |
| Domain Adaptation | DomainNet | Average Accuracy | 61.3 | GMDG (RegNetY-16GF, SWAD) |
| Domain Adaptation | DomainNet | Average Accuracy | 54.6 | GMDG (RegNetY-16GF) |
| Domain Adaptation | DomainNet | Average Accuracy | 47.3 | GMDG (ResNet-50, SWAD) |
| Domain Adaptation | DomainNet | Average Accuracy | 44.6 | GMDG (ResNet-50) |
| Domain Adaptation | VLCS | Average Accuracy | 82.4 | GMDG (RegNetY-16GF) |
| Domain Adaptation | VLCS | Average Accuracy | 82.2 | GMDG (RegNetY-16GF, SWAD) |
| Domain Adaptation | VLCS | Average Accuracy | 79.6 | GMDG (ResNet-50, SWAD) |
| Domain Adaptation | VLCS | Average Accuracy | 79.2 | GMDG (ResNet-50) |
| Domain Adaptation | TerraIncognita | Average Accuracy | 65 | GMDG (RegNetY-16GF, SWAD) |
| Domain Adaptation | TerraIncognita | Average Accuracy | 60.7 | GMDG (RegNetY-16GF) |
| Domain Adaptation | TerraIncognita | Average Accuracy | 53 | GMDG (ResNet-50, SWAD) |
| Domain Adaptation | TerraIncognita | Average Accuracy | 51.1 | GMDG (ResNet-50) |
| Domain Generalization | PACS | Average Accuracy | 97.9 | GMDG (RegNetY-16GF, SWAD) |
| Domain Generalization | PACS | Average Accuracy | 97.3 | GMDG (e RegNetY-16GF) |
| Domain Generalization | PACS | Average Accuracy | 88.4 | GMDG (ResNet-50, SWAD) |
| Domain Generalization | PACS | Average Accuracy | 85.6 | GMDG (ResNet-50) |
| Domain Generalization | Office-Home | Average Accuracy | 84.7 | GMDG (RegNetY-16GF, SWAD) |
| Domain Generalization | Office-Home | Average Accuracy | 80.8 | GMDG (RegNetY-16GF) |
| Domain Generalization | Office-Home | Average Accuracy | 72.5 | GMDG (ResNet-50, SWAD) |
| Domain Generalization | Office-Home | Average Accuracy | 70.7 | GMDG (ResNet-50) |
| Domain Generalization | DomainNet | Average Accuracy | 61.3 | GMDG (RegNetY-16GF, SWAD) |
| Domain Generalization | DomainNet | Average Accuracy | 54.6 | GMDG (RegNetY-16GF) |
| Domain Generalization | DomainNet | Average Accuracy | 47.3 | GMDG (ResNet-50, SWAD) |
| Domain Generalization | DomainNet | Average Accuracy | 44.6 | GMDG (ResNet-50) |
| Domain Generalization | VLCS | Average Accuracy | 82.4 | GMDG (RegNetY-16GF) |
| Domain Generalization | VLCS | Average Accuracy | 82.2 | GMDG (RegNetY-16GF, SWAD) |
| Domain Generalization | VLCS | Average Accuracy | 79.6 | GMDG (ResNet-50, SWAD) |
| Domain Generalization | VLCS | Average Accuracy | 79.2 | GMDG (ResNet-50) |
| Domain Generalization | TerraIncognita | Average Accuracy | 65 | GMDG (RegNetY-16GF, SWAD) |
| Domain Generalization | TerraIncognita | Average Accuracy | 60.7 | GMDG (RegNetY-16GF) |
| Domain Generalization | TerraIncognita | Average Accuracy | 53 | GMDG (ResNet-50, SWAD) |
| Domain Generalization | TerraIncognita | Average Accuracy | 51.1 | GMDG (ResNet-50) |