DeiT-S (AdamW, Cosine)

Reported on 4 benchmarks across 1 task · 1 paper · 3 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Adversarial4 results

Adversarial RobustnessonStylized ImageNet
Accuracy· 2021-11-10
13
SOTA
Are Transformers More Robust Than CNNs?arXiv:2111.05464
Adversarial RobustnessonImageNet-C
mean Corruption Error (mCE)· 2021-11-10
48
SOTA
Are Transformers More Robust Than CNNs?arXiv:2111.05464
Adversarial RobustnessonImageNet-A
Accuracy· 2021-11-10
12.2
SOTA
Are Transformers More Robust Than CNNs?arXiv:2111.05464
Adversarial RobustnessonImageNet
Accuracy· 2021-11-10
76.8
best: 77.4 (ResNet-50 (SGD, Cosine))
Are Transformers More Robust Than CNNs?arXiv:2111.05464