Who Cited It

Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications

2021 · Proceedings of the IEEE · 1,424 citations · 0 from inside this corpus

Wojciech Samek, Grégoire Montavon, Sebastian Lapuschkin, Christopher J. Anders, Klaus‐Robert Müller

With the broader and highly successful usage of machine learning (ML) in industry and the sciences, there has been a growing demand for explainable artificial intelligence (XAI). Interpretability and explanation methods for gaining a better understanding of the problem-solving abilities and strategies of nonlinear ML, in particular, deep neural networks, are, therefore, receiving increased attention. In this work, we aim to: 1) provide a timely overview of this active emerging field, with a focus on “post hoc” explanations, and explain its theoretical foundations; 2) put interpretability algorithms to a test both from a theory and comparative evaluation perspective using extensive simulations; 3) outline best practice aspects, i.e., how to best include interpretation methods into the standard usage of ML; and 4) demonstrate successful usage of XAI in a representative selection of application scenarios. Finally, we discuss challenges and possible future directions of this exciting foundational field of ML.

Explaining Deep Neural Networks and Beyond: A Review of Methods and Applications (2021)Explaining Deep Neural Networ…Long Short-Term Memory (1997)Long Short-Term MemoryThe Nature of Statistical Learning Theory (1995)The Nature of Statistical Lea…Neural networks for pattern recognition (1994)Neural networks for pattern r…Deep learning in neural networks: An overview (2014)Deep learning in neural netwo…Detecting Functionality-Specific Vulnerabilities via Retrieving Individual Functionality-… (2025)Detecting Functionality-Speci…"Why Should I Trust You?" (2016)"Why Should I Trust You?"Neural Machine Translation by Jointly Learning to Align and Translate (2014)Neural Machine Translation by…On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Deg… (2024)On a Method to Measure Superv…Neural Networks for Pattern Recognition (1995)Neural Networks for Pattern R…The perceptron: A probabilistic model for information storage and organization in the bra… (1958)The perceptron: A probabilist…The Nature of Statistical Learning Theory (2000)The Nature of Statistical Lea…On Estimation of a Probability Density Function and Mode (1962)On Estimation of a Probabilit…Gaussian Processes for Machine Learning (2005)Gaussian Processes for Machin…From local explanations to global understanding with explainable AI for trees (2020)From local explanations to gl…Stop explaining black box machine learning models for high stakes decisions and use inter… (2019)Stop explaining black box mac…The Graph Neural Network Model (2008)The Graph Neural Network ModelLearning with Kernels (2001)Learning with KernelsDeep Learning (2016)Deep LearningExplaining and Harnessing Adversarial Examples (2014)Explaining and Harnessing Adv…Nonlinear Component Analysis as a Kernel Eigenvalue Problem (1998)Nonlinear Component Analysis …Intriguing properties of neural networks (2013)Intriguing properties of neur…Deep Sparse Rectifier Neural Networks (2011)Deep Sparse Rectifier Neural …A survey of methods for explaining black box models (2019)A survey of methods for expla…Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond (2003)Learning With Kernels: Suppor…A survey on concept drift adaptation (2014)A survey on concept drift ada…An introduction to kernel-based learning algorithms (2001)Machine learning applications in cancer prognosis and prediction (2014)Towards A Rigorous Science of Interpretable Machine Learning (2017)Towards A Rigorous Science of…Methods for interpreting and understanding deep neural networks (2017)Methods for interpreting and …Axiomatic Attribution for Deep Networks (2017)Axiomatic Attribution for Dee…Deep Clustering for Unsupervised Learning of Visual Features (2018)Learning Important Features Through Propagating Activation Differences (2017)Learning Important Features T…Anchors: High-Precision Model-Agnostic Explanations (2018)Anchors: High-Precision Model…Causability and explainability of artificial intelligence in medicine (2019)Causability and explainabilit…Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks (2017)Reluplex: An Efficient SMT So…Intelligible Models for HealthCare (2015)Intelligible Models for Healt…
36 of 36 neighbouring works in this corpus. Blue is what this paper cites; orange is what cites it, and a dashed line is one neighbour citing another. Only the largest labels are drawn — every node carries its full title on hover.
this paper works it cites works citing it node size = global citations · hover for the full title

What this paper cites, inside the corpus

PaperYearCited
Long Short-Term Memory1997101,359
The Nature of Statistical Learning Theory199539,409
Neural networks for pattern recognition199418,720
Deep learning in neural networks: An overview201418,236
Detecting Functionality-Specific Vulnerabilities via Retrieving Individual Functionality-…202516,314
"Why Should I Trust You?"201616,210
Neural Machine Translation by Jointly Learning to Align and Translate201414,615
On a Method to Measure Supervised Multiclass Model’s Interpretability: Application to Deg…202413,528
Neural Networks for Pattern Recognition199512,273
The perceptron: A probabilistic model for information storage and organization in the bra…195811,965
The Nature of Statistical Learning Theory200010,734
On Estimation of a Probability Density Function and Mode196210,596
Gaussian Processes for Machine Learning200510,470
From local explanations to global understanding with explainable AI for trees20209,936
Stop explaining black box machine learning models for high stakes decisions and use inter…20199,924
The Graph Neural Network Model20089,662
Learning with Kernels20019,631
Deep Learning20168,952
Explaining and Harnessing Adversarial Examples20148,146
Nonlinear Component Analysis as a Kernel Eigenvalue Problem19988,138
Intriguing properties of neural networks20135,739
Deep Sparse Rectifier Neural Networks20115,428
A survey of methods for explaining black box models20194,992
Learning With Kernels: Support Vector Machines, Regularization, Optimization, and Beyond20034,332
A survey on concept drift adaptation20143,563
An introduction to kernel-based learning algorithms20013,498
Machine learning applications in cancer prognosis and prediction20143,382
Towards A Rigorous Science of Interpretable Machine Learning20173,190
Methods for interpreting and understanding deep neural networks20172,763
Axiomatic Attribution for Deep Networks20172,650
Deep Clustering for Unsupervised Learning of Visual Features20182,508
Learning Important Features Through Propagating Activation Differences20172,379
Anchors: High-Precision Model-Agnostic Explanations20182,124
Causability and explainability of artificial intelligence in medicine20191,851
Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks20171,709
Intelligible Models for HealthCare20151,693

Topics

Explainable Artificial Intelligence (XAI)Computer Science
Adversarial Robustness in Machine LearningComputer Science
Machine Learning and Data ClassificationComputer Science

Is this record sound?

complete

Nothing in this record contradicts itself and no field we check is missing.

  • supports5 author record(s) attached.
  • supports320 reference(s) recorded.
  • supportsThe DOI's year agrees with the publication year.
  • supportsA title is present.

Provenance

Everything above was read from one stored OpenAlex payload, fetched 2026-09-04T03:58:59+00:00.

sha256 59007f057c7dae86…