AdaBound

Reported on 4 benchmarks across 1 task · 1 paper · 1 SOTA

Note: results are matched by exact model name. Different papers may use the same name for different model variants.

Methodology4 results

Stochastic OptimizationonPenn Treebank (Character Level) 3x1000 LSTM - 500 Epochs
Bit per Character (BPC)· 2019-12-04
2.863
SOTA
Domain-independent Dominance of Adaptive Methods arXiv:1912.01823
Stochastic OptimizationonCIFAR-10 WRN-28-10 - 200 Epochs
Accuracy· 2019-12-04
94.6
best: 96.36 (Adam (eps-adjusted))
Domain-independent Dominance of Adaptive Methods arXiv:1912.01823
Stochastic OptimizationonImageNet ResNet-50 - 90 Epochs
Top 1 Accuracy· 2019-12-04
72.01
best: 76.51 (AvaGrad)
Domain-independent Dominance of Adaptive Methods arXiv:1912.01823
Stochastic OptimizationonCIFAR-100 WRN-28-10 - 200 Epochs
Accuracy· 2019-12-04
77.24
best: 81.24 (AvaGrad)
Domain-independent Dominance of Adaptive Methods arXiv:1912.01823