Backpropagation calculates dW
(weight delta) per weight per pattern, so it's straightforward how to modify weights when doing stochastic training. How do I use it for batch training, though? Simply accumluate dW
over the entire training set and then apply the modfication, or is there more to it?
Yes, just accumluate dW over the entire training set. At least that is how I coded it back in grad school...