Hermite Activation

Hermite Polynomial Activation

GeneralIntroduced 20193 papers

Description

A Hermite Activations is a type of activation function which uses a smooth finite Hermite polynomial base as a substitute for non-smooth ReLUs.

Relevant Paper: Lokhande et al

Papers Using This Method

Polynomial, trigonometric, and tropical activations2025-02-03The Expressivity and Training of Deep Neural Networks: toward the Edge of Chaos?2019-10-11Generating Accurate Pseudo-labels in Semi-Supervised Learning and Avoiding Overconfident Predictions via Hermite Polynomial Activations2019-09-12