Optimization

A branch of math dealing with optimizing a certain criterion (see loss) by choosing corresponding optimal parameters. The most generic and popular optimization algorithm might be (Stochastic) Gradient Descent