A vector with contributions of each feature to the prediction for every input object and the expected value of the model prediction for the object (average prediction given no knowledge about the object).
- is the contribution of the i-th feature.
- is the expected value of the model prediction.
For a given object the sum is equal to the prediction on this object.
This is an implementation of the Consistent Individualized Feature Attribution for Tree Ensembles approach.
See the ShapValues file format.
Use the SHAP package to plot the returned values.
- is the number of input features.
- is the set of all input features.
- is the set of non-zero feature indices (the features that are being observed and not unknown).
is the model's prediction for the input , where is the expected value of the function conditioned on a subset S of the input features.
The feature importance is calculated as follows for each feature :