Monday, February 09, 2026

Activation function: Sigmoid (≈1980s)

 Sigmoid (≈1980s)

Smooth, bounded, probabilistic. A fantasy of harmony and closure.
→ Learning stalls. Gradients vanish.



Posted by at

No comments:

Post a Comment

Subscribe to: Post Comments (Atom)