Play with optimization algorithms.
About code.
In this code researched Gradient or Cauchy method - first order method vs Newton's method - second order method
The code illustrates the advantages of the second order method over the first order method.
The classical gradient algorithm has been writed and ploted its convergence.
The Newton's method has been writed.
This is a second-order method using the Hessian matrix - a matrix of estimates of the second derivatives.
The convergence of Newton's method is investigated vs Gradient convergence.