Cyclical Learning Rate Policy
Description
A Cyclical Learning Rate Policy combines a linear learning rate decay with warm restarts.
Image: ESPNetv2
Papers Using This Method
Semantic sentence similarity: size does not always matter2021-06-16Automated diagnosis of COVID-19 with limited posteroanterior chest X-ray images using fine-tuned deep neural networks2020-04-23Applying Cyclical Learning Rate to Neural Machine Translation2020-04-06Language learning using Speech to Image retrieval2019-09-09ESPNetv2: A Light-weight, Power Efficient, and General Purpose Convolutional Neural Network2018-11-28