Interpretability


Methods and techniques in the application of artificial intelligence technology (AI) such that the results of the solution can be understood by human experts.

Getting started

Interpretable Machine Learning
Extracting human understandable insights from any Machine Learning model.
interpretability ermutation-importance partial-dependence-plots shap-values
Lime: Local Interpretable Model-Agnostic Explanations
Explains the predictions of any classifier in an interpretable and faithful manner, by learning an interpretable model locally around the prediction.
interpretability lime code research
SHAP: SHapley Additive exPlanations
A game theoretic approach to explain the output of any machine learning model.
interpretability shap explainability gradient-boosting
ELI5
A library for debugging/inspecting machine learning classifiers and explaining their predictions.
interpretability eli5 debugging inspection

Tutorials

GANSpace: Discovering Interpretable GAN Controls
This paper describes a simple technique to analyze Generative Adversarial Networks (GANs) and create interpretable controls for image synthesis.
generative-adversarial-networks image-generation interpretability interpretable-gans
Neural-Backed Decision Trees
Combine interpretability of a decision tree with accuracy of a neural network.
decision-trees neural-networks deep-learning interpretability
Interpretable Machine Learning
Extracting human understandable insights from any Machine Learning model.
interpretability ermutation-importance partial-dependence-plots shap-values
CNN Explainer
CNN Explainer uses TensorFlow.js, an in-browser GPU-accelerated deep learning library to load the pretrained model for visualization.
convolutional-neural-networks tensorflow-js interactive interpretability
AllenNLP Interpret
A Framework for Explaining Predictions of NLP Models
interpretability explainability natural-language-processing api

Libraries

Curation of Non-Mainstream ML Libraries
A curated list of 100+ non-mainstream libraries for all parts of the Machine Learning workflow
library machine-learning data-collection data-augmentation
CNN Explainer
CNN Explainer uses TensorFlow.js, an in-browser GPU-accelerated deep learning library to load the pretrained model for visualization.
convolutional-neural-networks tensorflow-js interactive interpretability
AllenNLP Interpret
A Framework for Explaining Predictions of NLP Models
interpretability explainability natural-language-processing api

Research

BERTology Meets Biology
Interpreting Attention in Protein Language Models.
bert healthcare biology health
GANSpace: Discovering Interpretable GAN Controls
This paper describes a simple technique to analyze Generative Adversarial Networks (GANs) and create interpretable controls for image synthesis.
generative-adversarial-networks image-generation interpretability interpretable-gans
Neural-Backed Decision Trees
Combine interpretability of a decision tree with accuracy of a neural network.
decision-trees neural-networks deep-learning interpretability
AllenNLP Interpret
A Framework for Explaining Predictions of NLP Models
interpretability explainability natural-language-processing api

Recent

BERTology Meets Biology
Interpreting Attention in Protein Language Models.
bert healthcare biology health
Using Selective Attention in Reinforcement Learning Agents
In this work, we establish that self-attention can be viewed as a form of indirect encoding, which enables us to construct highly parameter-efficient ...
reinforcement-learning self-attention selective-attention neuroevolution
SuperGlue: Learning Feature Matching with Graph Neural Networks
SuperGlue, a neural network that matches two sets of local features by jointly finding correspondences and rejecting non-matchable points.
graph-neural-networks superglue visual-localization image-matching
Interpretable Machine Learning for Computer Vision
Recent progress we made on visualization, interpretation, and explanation methodologies for analyzing both the data and the models in computer vision.
computer-vision interpretability cvpr-2020 article
Table of Contents
Share a resource
Share a resource you found useful for this specific topic.
Topic experts
Share