Lookahead

Reported on 2 benchmarks across 1 task · 1 paper · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Methodology2 results

Stochastic OptimizationonCIFAR-10 ResNet-18 - 200 Epochs
Accuracy· 2019-07-19
95.27
best: 95.55 (SGD - cosine LR schedule)
SOTA
Lookahead Optimizer: k steps forward, 1 step back arXiv:1907.08610
Stochastic OptimizationonImageNet ResNet-50 - 60 Epochs
Top 5 Accuracy· 2019-07-19
92.53
best: 92.56 (SGD)
Lookahead Optimizer: k steps forward, 1 step back arXiv:1907.08610