keywords: nonlinear optimization, pattern search, augmented lagrangian, karush-kuhn-tucker, constrained optimization, conjugate gradient methods, quasi newton methods, line search descent methods, onedimensional and multidimensional optimazation

Interactive demo of Hooke_Jeeves and Powell algorithms used for direct-search function optimisation.

Reimplementation of optimization algorithms.

Nonlinear optimization algorithms implemented in Python with demo programs