[Back]

R. Hasani, A. Amini, M. Lechner, F. Naser, R. Grosu, D. Rus:
"Response Characterization for Auditing Cell Dynamics in Long Short-term Memory Networks";
Talk: IEEE International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary; 2019-07-14 - 2019-07-19; in: "2019 IEEE International Joint Conference on Neural Networks (IJCNN)", (2019), ISSN: 2161-4407; 1 - 8.

In this paper, we introduce a novel method to interpret recurrent neural networks (RNNs), particularly long short-term memory networks (LSTMs) at the cellular level. We propose a systematic pipeline for interpreting individual hidden state dynamics within the network using response characterization methods. The ranked contribution of individual cells to the network's output is computed by analyzing a set of interpretable metrics of their decoupled step and sinusoidal responses. As a result, our method is able to uniquely identify neurons with insightful dynamics, quantify relationships between dynamical properties and test accuracy through ablation analysis, and interpret the impact of network capacity on a network's dynamical distribution. Finally, we demonstrate the generalizability and scalability of our method by evaluating a series of different benchmark sequential datasets.

http://dx.doi.org/10.1109/IJCNN.2019.8851954