Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual Conditional Expectation
Alex Goldstein low, Adam Kapelner, Justin Bleich low, Emil Pitkin low
This article presents individual conditional expectation (ICE) plots, a tool for visualizing the model estimated by any supervised learning algorithm. Classical partial dependence plots (PDPs) help visualize the average partial relationship between the predicted response and one or more features. In the presence of substantial interaction effects, the partial response relationship can be heterogeneous. Thus, an average curve, such as the PDP, can obfuscate the complexity of the modeled relationship. Accordingly, ICE plots refine the PDP by graphing the functional relationship between the predicted response and the feature for individual observations. Specifically, ICE plots highlight the variation in the fitted values across the range of a covariate, suggesting where and to what extent heterogeneities might exist. In addition to providing a plotting suite for exploratory analysis, we include a visual test for additive structure in the data-generating model. Through simulated examples and real datasets, we demonstrate how ICE plots can shed light on estimated models in ways PDPs cannot. Procedures outlined are available in the R package ICEbox.
Citation edge evidence
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challe…→Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…Legacy edge — source detail unavailable
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)→Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…Legacy edge — source detail unavailable
- A survey of methods for explaining black box models→Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…Legacy edge — source detail unavailable
- Explainable AI: A Review of Machine Learning Interpretability Methods→Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…Legacy edge — source detail unavailable
- Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence→Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…Legacy edge — source detail unavailable
- Machine Learning Interpretability: A Survey on Methods and Metrics→Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…Legacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustw…→Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…Legacy edge — source detail unavailable
- Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Models→Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…Legacy edge — source detail unavailable
- Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…→Random ForestsLegacy edge — source detail unavailable
- Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…→Greedy function approximation: A gradient boosting machine.Legacy edge — source detail unavailable
- Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…→Classification and Regression by randomForestLegacy edge — source detail unavailable
- Peeking Inside the Black Box: Visualizing Statistical Learning With Plots of Individual C…→Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)Legacy edge — source detail unavailable
- Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)→Random ForestsLegacy edge — source detail unavailable
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)→Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)Legacy edge — source detail unavailable
- Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)→A survey of methods for explaining black box modelsLegacy edge — source detail unavailable
- Machine Learning Interpretability: A Survey on Methods and Metrics→Greedy function approximation: A gradient boosting machine.Legacy edge — source detail unavailable
- Machine Learning Interpretability: A Survey on Methods and Metrics→Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)Legacy edge — source detail unavailable
- Machine Learning Interpretability: A Survey on Methods and Metrics→Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)Legacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challe…→Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)Legacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challe…→A survey of methods for explaining black box modelsLegacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challe…→Visualizing the Effects of Predictor Variables in Black Box Supervised Learning ModelsLegacy edge — source detail unavailable
- Visualizing the Effects of Predictor Variables in Black Box Supervised Learning Models→Greedy function approximation: A gradient boosting machine.Legacy edge — source detail unavailable
- Explainable AI: A Review of Machine Learning Interpretability Methods→Greedy function approximation: A gradient boosting machine.Legacy edge — source detail unavailable
- Explainable AI: A Review of Machine Learning Interpretability Methods→Classification and Regression by randomForestLegacy edge — source detail unavailable
- Explainable AI: A Review of Machine Learning Interpretability Methods→Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)Legacy edge — source detail unavailable
- Explainable AI: A Review of Machine Learning Interpretability Methods→A survey of methods for explaining black box modelsLegacy edge — source detail unavailable
- Explainable AI: A Review of Machine Learning Interpretability Methods→Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challe…Legacy edge — source detail unavailable
- Explainable AI: A Review of Machine Learning Interpretability Methods→Visualizing the Effects of Predictor Variables in Black Box Supervised Learning ModelsLegacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustw…→Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)Legacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustw…→Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)Legacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustw…→A survey of methods for explaining black box modelsLegacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustw…→Machine Learning Interpretability: A Survey on Methods and MetricsLegacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustw…→Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challe…Legacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustw…→Visualizing the Effects of Predictor Variables in Black Box Supervised Learning ModelsLegacy edge — source detail unavailable
- Explainable Artificial Intelligence (XAI): What we know and what is left to attain Trustw…→Explainable AI: A Review of Machine Learning Interpretability MethodsLegacy edge — source detail unavailable
- Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence→Greedy function approximation: A gradient boosting machine.Legacy edge — source detail unavailable
- Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence→Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author)Legacy edge — source detail unavailable
- Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence→Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)Legacy edge — source detail unavailable
- Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence→Random ForestsLegacy edge — source detail unavailable
- Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence→Explainable Artificial Intelligence (XAI): Concepts, taxonomies, opportunities and challe…Legacy edge — source detail unavailable
- Interpreting Black-Box Models: A Review on Explainable Artificial Intelligence→Visualizing the Effects of Predictor Variables in Black Box Supervised Learning ModelsLegacy edge — source detail unavailable
What this paper cites, inside the corpus
| Paper | Year | Cited |
|---|---|---|
| Random Forests | 2001 | 131,109 |
| Greedy function approximation: A gradient boosting machine. | 2001 | 30,137 |
| Classification and Regression by randomForest | 2007 | 18,420 |
| Statistical Modeling: The Two Cultures (with comments and a rejoinder by the author) | 2001 | 4,362 |
What cites it, inside the corpus
Links
Download BibTeX · Download RIS · DOI · Open access copy · OpenAlex record
Topics
| Data Analysis with R | Computer Science |
| Statistical Methods and Inference | Mathematics |
| Mental Health Research Topics | Psychology |
Is this record sound?
complete
Nothing in this record contradicts itself and no field we check is missing.
- supports4 author record(s) attached.
- supports29 reference(s) recorded.
- supportsThe DOI's year agrees with the publication year.
- supportsA title is present.
Provenance
sha256 930f5bc64fea8a60…