Gradient Descent (Steepest Descent Method)

Natural & Formal Sciences Dictionary
An iterative optimization algorithm that updates parameters by moving them opposite to the gradient of an objective function (or an estimate thereof) to reduce the function value and seek a local minimum.