ScaledSoftSign

GeneralIntroduced 20001 papers

Description

The ScaledSoftSign is a modification of SoftSign activation function that has trainable parameters.

ScaledSoftSign(x)=αxβ+xScaledSoftSign(x) = \frac{\alpha x}{\beta + |x|}

Papers Using This Method