How Can I Explain This to You? An Empirical Study of Deep Neural Network Explanation Methods [Conference Paper]

NESL Technical Report #: 2020-12-4

Authors:

Abstract: Explaining the inner workings of deep neural network models have received considerable attention in recent years. Researchers have attempted to provide human parseable explanations justifying why a model performed a specific classification. Although many of these toolkits are available for use, it is unclear which style of explanation is preferred by end-users, thereby demanding investigation. We performed a cross-analysis Amazon Mechanical Turk study comparing the popular state-of-the-art explanation methods to empirically determine which are better in explaining model decisions. The participants were asked to compare explanation methods across applications spanning image, text, audio, and sensory domains. Among the surveyed methods, explanation-by-example was preferred in all domains except text sentiment classification, where LIME’s method of annotating input text was preferred. We highlight qualitative aspects of employing the studied explainability methods and conclude with implications for researchers and engineers that seek to incorporate explanations into user-facing deployments.

External paper URL

Publication Forum: NeurIPS

Volume: 33

Date: 2020-12-07

Public Document?: Yes

NESL Document?: Yes

Document category: Conference Paper

Primary Research Area: Applications

Back