An overview of the foundations and algorithms for solving nonlinear continuous optimization problems with special emphasis on the applications to machine learning and artificial intelligence.