 ##  [Gradient Descent (Steepest Descent Method)](/gradient-descent-steepest-descent-method) 

  ##  [Gradient Descent (Steepest Descent Method)](https://natural.quantumdictionary.io/gradient-descent-steepest-descent-method-0) 

  
 [![Natural & Formal Sciences Dictionary](/sites/default/files/styles/large/public/2026-01/Natural%20%26%20Formal%20Sciences.png.webp?itok=2kCDRVQv)](/topic-specific-dictionaries/natural-formal-sciences)


**Natural &amp; Formal Sciences Dictionary**

 
Definition

An iterative optimization algorithm that updates parameters by moving them opposite to the gradient of an objective function (or an estimate thereof) to reduce the function value and seek a local minimum.