Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks

In the last five years, the inclusion of Deep Learning algorithms in prognostics and health management (PHM) has led to a performance increase in diagnostics, prognostics, and anomaly detection. However, the lack of interpretability of these models results in resistance towards their deployment. Dee...

Full description

Bibliographic Details
Main Authors: Joaquín Figueroa Barraza, Enrique López Droguett, Marcelo Ramos Martins
Format: Article
Language:English
Published: MDPI AG 2021-09-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/17/5888
id doaj-e72334c5c3e243f5a4f40bbed0717e29
record_format Article
spelling doaj-e72334c5c3e243f5a4f40bbed0717e292021-09-09T13:56:40ZengMDPI AGSensors1424-82202021-09-01215888588810.3390/s21175888Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural NetworksJoaquín Figueroa Barraza0Enrique López Droguett1Marcelo Ramos Martins2LabRisco—Analysis, Evaluation and Risk Management Laboratory, Department of Naval Architecture and Ocean Engineering, University of São Paulo, São Paulo 05508-030, BrazilDepartment of Civil and Environmental Engineering & The Garrick Institute for the Risk Sciences, University of California, Los Angeles, CA 90095, USALabRisco—Analysis, Evaluation and Risk Management Laboratory, Department of Naval Architecture and Ocean Engineering, University of São Paulo, São Paulo 05508-030, BrazilIn the last five years, the inclusion of Deep Learning algorithms in prognostics and health management (PHM) has led to a performance increase in diagnostics, prognostics, and anomaly detection. However, the lack of interpretability of these models results in resistance towards their deployment. Deep Learning-based models fall within the accuracy/interpretability tradeoff, which means that their complexity leads to high performance levels but lacks interpretability. This work aims at addressing this tradeoff by proposing a technique for feature selection embedded in deep neural networks that uses a feature selection (FS) layer trained with the rest of the network to evaluate the input features’ importance. The importance values are used to determine which will be considered for deployment of a PHM model. For comparison with other techniques, this paper introduces a new metric called ranking quality score (RQS), that measures how performance evolves while following the corresponding ranking. The proposed framework is exemplified with three case studies involving health state diagnostics and prognostics and remaining useful life prediction. Results show that the proposed technique achieves higher RQS than the compared techniques, while maintaining the same performance level when compared to the same model but without an FS layer.https://www.mdpi.com/1424-8220/21/17/5888feature selectiondeep learningdeep neural networksprognostics and health managementinterpretable AI
collection DOAJ
language English
format Article
sources DOAJ
author Joaquín Figueroa Barraza
Enrique López Droguett
Marcelo Ramos Martins
spellingShingle Joaquín Figueroa Barraza
Enrique López Droguett
Marcelo Ramos Martins
Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks
Sensors
feature selection
deep learning
deep neural networks
prognostics and health management
interpretable AI
author_facet Joaquín Figueroa Barraza
Enrique López Droguett
Marcelo Ramos Martins
author_sort Joaquín Figueroa Barraza
title Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks
title_short Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks
title_full Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks
title_fullStr Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks
title_full_unstemmed Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks
title_sort towards interpretable deep learning: a feature selection framework for prognostics and health management using deep neural networks
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2021-09-01
description In the last five years, the inclusion of Deep Learning algorithms in prognostics and health management (PHM) has led to a performance increase in diagnostics, prognostics, and anomaly detection. However, the lack of interpretability of these models results in resistance towards their deployment. Deep Learning-based models fall within the accuracy/interpretability tradeoff, which means that their complexity leads to high performance levels but lacks interpretability. This work aims at addressing this tradeoff by proposing a technique for feature selection embedded in deep neural networks that uses a feature selection (FS) layer trained with the rest of the network to evaluate the input features’ importance. The importance values are used to determine which will be considered for deployment of a PHM model. For comparison with other techniques, this paper introduces a new metric called ranking quality score (RQS), that measures how performance evolves while following the corresponding ranking. The proposed framework is exemplified with three case studies involving health state diagnostics and prognostics and remaining useful life prediction. Results show that the proposed technique achieves higher RQS than the compared techniques, while maintaining the same performance level when compared to the same model but without an FS layer.
topic feature selection
deep learning
deep neural networks
prognostics and health management
interpretable AI
url https://www.mdpi.com/1424-8220/21/17/5888
work_keys_str_mv AT joaquinfigueroabarraza towardsinterpretabledeeplearningafeatureselectionframeworkforprognosticsandhealthmanagementusingdeepneuralnetworks
AT enriquelopezdroguett towardsinterpretabledeeplearningafeatureselectionframeworkforprognosticsandhealthmanagementusingdeepneuralnetworks
AT marceloramosmartins towardsinterpretabledeeplearningafeatureselectionframeworkforprognosticsandhealthmanagementusingdeepneuralnetworks
_version_ 1717759462982287360