Gradient descent
Repeatedly nudging the parameters a little way against the gradient, so the loss goes down.
Gradient descent repeats one simple move: new setting = old setting − learning rate × steepness.
See it in action
Try gradient descent hands-on in the lesson Gradient descent, part of the AI fundamentals course.