Calculate and plot a set of statistics for the chosen feature.
An example of plotted statistics:
The X-axis of the resulting chart contains values of the feature divided into buckets. For numerical features, the splits between buckets represent conditions (feature < value) from the trees of the model. For categorical features, each bucket stands for a category.
The Y-axis of the resulting chart contains the following graphs:
Average target (label) value in the bucket.
Average prediction in the bucket.
Number of objects in the bucket.
Average predictions on varying values of the feature.
To calculate it, the value of the feature is successively changed to fall into every bucket for every input object. The value for a bucket on the graph is calculated as the average for all objects when their feature values are changed to fall into this bucket.
The return value of the function contains the data from these graps.
The following information is used for calculation:
- Trained model
- Label values
- Only models with one-hot encoded categorical features are supported. Set the one_hot_max_size parameter to a large value to ensure that one-hot encoding is applied to all categorical features in the model.
- Multiclassification modes are not supported.
Method call format
calc_feature_statistics(data, target=None, feature=None, prediction_type=None, cat_feature_values=None, plot=True, max_cat_features_on_plot=10, thread_count=-1, plot_file=None)
|Parameter||Possible types||Description||Default value|
|data|| || |
The data to calculate the statistics on.
|target|| || |
Label values for objects from the input data.
|feature|| || |
The feature index, name or a list of any their combination to calculate the statistics for.
Output information regarding a single feature indexed 0:
Output information regarding two features, one of which is named
The prediction type to calculate the mean prediction.
|None (Probability for Logloss and RawFormulaVal, CrossEntropy for all other loss functions)|
|cat_feature_values|| || |
A list of categorical feature values to calculate the statistics on. Can be used if statistics are calculated for a categorical feature.
|None (statistics are calculated for all|