Explainable AI

Current research on explainability and interpretability of machine learning algorithms

This site is a community effort by the Explainable AI members. Please join the group and reach out to the administrators if you have any questions.

Made with Jekyll and Hyde. Idea and base code for the website adapted from ml4code.

A Benchmark for Interpretability Methods in Deep Neural Networks

Sara Hooker, Dumitru Erhan, Pieter-Jan Kindermans, Been Kim. 2018

[ArXiv]    

We propose an empirical measure of the approximate accuracy of feature importance estimates in deep neural networks. Our results across several large-scale image classification datasets show that many popular interpretability methods produce estimates of feature importance that are not better than a random designation of feature importance. Only certain ensemble based approaches—VarGrad and SmoothGrad-Squared—outperform such a random assignment of importance. The manner of ensembling remains critical, we show that some approaches do no better then the underlying method but carry a far higher computational burden.