Gaussian Calibration Linear Unit
Assuming the input is xxx, and x∼N(0,1)x\sim \mathcal{N}(0,1)x∼N(0,1). The final response value is f(x)f(x)f(x), the formulaic expression is:
f(x)=x∗(2−Φ(x)),x>0f(x)= x * (2- \Phi(x)), x > 0f(x)=x∗(2−Φ(x)),x>0 f(x)=x∗Φ(x),x≤0 f(x)= x * \Phi(x), x \le 0f(x)=x∗Φ(x),x≤0