QueryCrossEntropy

Let's assume that it is required to solve a classification problem on a dataset with grouped objects. For example, it may be required to predict user clicks on a search engine results page.

Generally, this task can be solved by the Logloss function:

•  is the label value for the i-th object (from the input data for training). Possible values are in the range .
• is the Logloss raw formula prediction.
• is the predicted probability that the object belongs to the positive class. (refer to the Logistic function, odds, odds ratio, and logit section of the Logistic regression article in Wikipedia for details).

Since the internal structure of the data is known, it can be assumed that the predictions in various groups are different. This can be modeled by adding a to each formula prediction for a group:

The parameter is jointly optimized for each group during the training.

In this case, the Logloss formula for grouped objects takes the following form:

The QueryCrossEntropy metric is calculated as follows:

User-defined parameters

Parameter: alpha

Description

The coefficient used in quantile-based losses. Defines the rules for mixing the

and

versions of the Logloss function.