Overfitting detector

If overfitting occurs, CatBoost can stop the training earlier than the training parameters dictate. For example, it can be stopped before the specified number of trees are built. This option is set in the starting parameters.

The following overfitting detection methods are supported:

IncToDec

Before building each new tree, CatBoost checks the resulting loss change on the test dataset. The overfit detector is triggered if the $\text{[math]}$ value set in the starting parameters is greater than $\text{[math]}$ :

$\text{[math]}$

How $\text{[math]}$ is calculated from a set of values for the maximizing metric $\text{[math]}$ :

$\text{[math]}$ is calculated:
$\text{[math]}$
$\text{[math]}$ is calculated:
$\text{[math]}$
$\text{[math]}$ is calculated:
$\text{[math]}$

Iter

Before building each new tree, CatBoost checks the number of iterations since the iteration with the optimal loss function value.

The model is considered overfitted if the number of iterations exceeds the value specified in the training parameters.