Activation function: Tanh (late 1980s–1990s)

 tanh (late 80s–90s)

Introduces symmetry and negativity.
Acknowledges internal tension.

→ Still saturates.
→ Lack is admitted, but neutralized too early.