NormLinComb

The Normalized Linear Combination of Activations, or NormLinComb, is a type of activation function that has trainable parameters and uses the normalized linear combination of other activation functions.

$NormLinComb(x) = \frac{\sum\limits_{i=0}^{n} w_i \mathcal{F}_i(x)}{\mid \mid W \mid \mid}$