This page describes the concept of momentum in gradient descent:
It is a way of using information from prior steps, not just the local surface where you are now.
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!