Lecun's Tanh
GeneralIntroduced 1998
Description
LeCun's tanh is an activation function of the form . The constants were chosen to keep the variance of the output close to 1.
LeCun's tanh is an activation function of the form . The constants were chosen to keep the variance of the output close to 1.