resnet110 (T:resnet110 S:resnet20)

Reported on 1 benchmark across 1 task · 4 papers

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Natural Language Processing4 results

Knowledge DistillationonCIFAR-100
Top-1 Accuracy (%)· 2021-12-01
71.99
best: 79.86 (SRD (T:resnet-32x4, S:shufflenet-v2))
Information Theoretic Representation Distillation arXiv:2112.00459
Knowledge DistillationonCIFAR-100
Top-1 Accuracy (%)· 2020-12-15
71.88
best: 79.86 (SRD (T:resnet-32x4, S:shufflenet-v2))
Wasserstein Contrastive Representation Distillation arXiv:2012.08674
Knowledge DistillationonCIFAR-100
Top-1 Accuracy (%)· 2019-10-23
71.56
best: 79.86 (SRD (T:resnet-32x4, S:shufflenet-v2))
Contrastive Representation Distillation arXiv:1910.10699
Knowledge DistillationonCIFAR-100
Top-1 Accuracy (%)· 2015-03-09
70.67
best: 79.86 (SRD (T:resnet-32x4, S:shufflenet-v2))
Distilling the Knowledge in a Neural Network arXiv:1503.02531