Description
This method combines multiple optimization techniques like ADAM and SGD or PADAM. This method can be applied to any couple of optimizers.
Image credit: Combining Optimization Methods Using an Adaptive Meta Optimizer
This method combines multiple optimization techniques like ADAM and SGD or PADAM. This method can be applied to any couple of optimizers.
Image credit: Combining Optimization Methods Using an Adaptive Meta Optimizer