Characteristics of backpropagation

• Any number of layers

• Only feedforward, no cycles (though a more general versions does allow this)

• Use continuous nodes

  • Must have differentiable activation rule
  • Typically, logistic: S-shape between 0 and 1

• Initial weights are random

• Total error never decreases (gradient descent in error space)