Diverging
When steps overshoot by more each time and the loss grows instead of shrinking.
See it in action
Try diverging hands-on in the lesson Gradient descent, part of the AI fundamentals course.
Open the lesson
When steps overshoot by more each time and the loss grows instead of shrinking.
Try diverging hands-on in the lesson Gradient descent, part of the AI fundamentals course.