Monday, February 09, 2026

Activation function: Sigmoid (≈1980s)

 Sigmoid (≈1980s)

Smooth, bounded, probabilistic. A fantasy of harmony and closure.
→ Learning stalls. Gradients vanish.



No comments: