Learning rate

A hyperparameter that sets how big each gradient descent step is.

Gradient descent repeats one simple move: new setting = old setting − learning rate × steepness.
From Gradient descent, step “Step downhill, then look again”

See it in action

Try learning rate hands-on in the lesson Gradient descent, part of the AI fundamentals course.

Open the lesson