ReLUN

Rectified Linear Unit N

GeneralIntroduced 20001 papers

Description

The Rectified Linear Unit N, or ReLUN, is a modification of ReLU6 activation function that has trainable parameter n.

ReLUN(x)=min(max(0,x),n)ReLUN(x) = min(max(0, x), n)

Papers Using This Method