Search code examples
batch-filemachine-learningneural-networkbackpropagation

Backpropagation and batch training


Backpropagation calculates dW (weight delta) per weight per pattern, so it's straightforward how to modify weights when doing stochastic training. How do I use it for batch training, though? Simply accumluate dW over the entire training set and then apply the modfication, or is there more to it?


Solution

  • Yes, just accumluate dW over the entire training set. At least that is how I coded it back in grad school...