LinComb

The Linear Combination of Activations, or LinComb, is a type of activation function that has trainable parameters and uses the linear combination of other activation functions.

$LinComb(x) = \sum\limits_{i=0}^{n} w_i \mathcal{F}_i(x)$