Liornemel \\ Activation Function

Bla bla bla bla

Charts

X range: [-5, 5]. Values are computed client-side.

ReLU

Sigmoid

Tanh

Leaky ReLU (α=0.1)

ELU (α=1)

Softplus

GELU (approx)