SGD

Reported on 5 benchmarks across 1 task · 2 papers · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Methodology5 results

Stochastic OptimizationonImageNet ResNet-50 - 60 Epochs
Top 5 Accuracy· 2019-07-19
92.56
SOTA
Lookahead Optimizer: k steps forward, 1 step back arXiv:1907.08610
Stochastic OptimizationonCIFAR-10 WRN-28-10 - 200 Epochs
Accuracy· 2019-12-04
96.14
best: 96.36 (Adam (eps-adjusted))
Domain-independent Dominance of Adaptive Methods arXiv:1912.01823
Stochastic OptimizationonImageNet ResNet-50 - 90 Epochs
Top 1 Accuracy· 2019-12-04
75.99
best: 76.51 (AvaGrad)
Domain-independent Dominance of Adaptive Methods arXiv:1912.01823
Stochastic OptimizationonCIFAR-100 WRN-28-10 - 200 Epochs
Accuracy· 2019-12-04
80.95
best: 81.24 (AvaGrad)
Domain-independent Dominance of Adaptive Methods arXiv:1912.01823
Stochastic OptimizationonCIFAR-10 ResNet-18 - 200 Epochs
Accuracy· 2019-07-19
95.23
best: 95.55 (SGD - cosine LR schedule)
Lookahead Optimizer: k steps forward, 1 step back arXiv:1907.08610