Margin ReLU

Margin Rectified Linear Unit

GeneralIntroduced 20002 papers

Description

Margin Rectified Linear Unit, or Margin ReLU, is a type of activation function based on a ReLU, but it has a negative threshold for negative values instead of a zero threshhold.

Papers Using This Method