Backpropagation algorithm in rules

• weight change = some small constant ? error ? input activation

• For an output node, the error is:

  error = (target activation - output activation) ? output activation ? (1 - output activation)
  

• For a hidden node, the error is:

  error = weighted sum of to-node errors ? hidden activation ? (1 - hidden activation)