Regularisation

A penalty added during training that discourages overly complex models, such as large coefficients.

Another fix is regularisation: we change what the model is trying to do, from “fit the points” to “fit the points, but pay a price for large coefficients”.
From Overfitting, step “Regularisation: a penalty for wiggling”

See it in action

Try regularisation hands-on in the lesson Overfitting, part of the AI fundamentals course.

Open the lesson