Logistic function

• S-shaped between 0 and 1

• Approaches a linear function around x = 0

• Its rate-of-change (derivative) for a node with a given activation is:

activation ? (1 - activation)