Methods of Minimization
Methods using no function derivatives
- Simulated Annealing, Monte Carlo, Simplex, Metropolis
Methods using first derivatives
- Steepest descent, Conjugate gradient
Methods using first and second derivatives
- Full matrix, Block diagonal, Diagonal, Preconditioned Conjugate Gradient (, and Conjugate Gradient II)