AHAF

Adaptive Hybrid Activation Function

GeneralIntroduced 20002 papers
Source Paper

Description

Trainable activation function as a sigmoid-based generalization of ReLU, Swish and SiLU.

Papers Using This Method

Learnable Extended Activation Function (LEAF) for Deep Neural Networks2023-09-30Adaptive hybrid activation function for deep neural networks2022-04-25