Optimization

Optimization turns a goal into an objective function, identifies constraints, and searches for inputs that minimize or maximize the objective. Begin with the real-world formulation note, then use log loss as the bridge into machine learning.

For a deeper treatment after this branch, continue to Deep Learning Book: Optimization for Training Deep Models.