Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks
In the last five years, the inclusion of Deep Learning algorithms in prognostics and health management (PHM) has led to a performance increase in diagnostics, prognostics, and anomaly detection. However, the lack of interpretability of these models results in resistance towards their deployment. Dee...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-09-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/21/17/5888 |
id |
doaj-e72334c5c3e243f5a4f40bbed0717e29 |
---|---|
record_format |
Article |
spelling |
doaj-e72334c5c3e243f5a4f40bbed0717e292021-09-09T13:56:40ZengMDPI AGSensors1424-82202021-09-01215888588810.3390/s21175888Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural NetworksJoaquín Figueroa Barraza0Enrique López Droguett1Marcelo Ramos Martins2LabRisco—Analysis, Evaluation and Risk Management Laboratory, Department of Naval Architecture and Ocean Engineering, University of São Paulo, São Paulo 05508-030, BrazilDepartment of Civil and Environmental Engineering & The Garrick Institute for the Risk Sciences, University of California, Los Angeles, CA 90095, USALabRisco—Analysis, Evaluation and Risk Management Laboratory, Department of Naval Architecture and Ocean Engineering, University of São Paulo, São Paulo 05508-030, BrazilIn the last five years, the inclusion of Deep Learning algorithms in prognostics and health management (PHM) has led to a performance increase in diagnostics, prognostics, and anomaly detection. However, the lack of interpretability of these models results in resistance towards their deployment. Deep Learning-based models fall within the accuracy/interpretability tradeoff, which means that their complexity leads to high performance levels but lacks interpretability. This work aims at addressing this tradeoff by proposing a technique for feature selection embedded in deep neural networks that uses a feature selection (FS) layer trained with the rest of the network to evaluate the input features’ importance. The importance values are used to determine which will be considered for deployment of a PHM model. For comparison with other techniques, this paper introduces a new metric called ranking quality score (RQS), that measures how performance evolves while following the corresponding ranking. The proposed framework is exemplified with three case studies involving health state diagnostics and prognostics and remaining useful life prediction. Results show that the proposed technique achieves higher RQS than the compared techniques, while maintaining the same performance level when compared to the same model but without an FS layer.https://www.mdpi.com/1424-8220/21/17/5888feature selectiondeep learningdeep neural networksprognostics and health managementinterpretable AI |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Joaquín Figueroa Barraza Enrique López Droguett Marcelo Ramos Martins |
spellingShingle |
Joaquín Figueroa Barraza Enrique López Droguett Marcelo Ramos Martins Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks Sensors feature selection deep learning deep neural networks prognostics and health management interpretable AI |
author_facet |
Joaquín Figueroa Barraza Enrique López Droguett Marcelo Ramos Martins |
author_sort |
Joaquín Figueroa Barraza |
title |
Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks |
title_short |
Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks |
title_full |
Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks |
title_fullStr |
Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks |
title_full_unstemmed |
Towards Interpretable Deep Learning: A Feature Selection Framework for Prognostics and Health Management Using Deep Neural Networks |
title_sort |
towards interpretable deep learning: a feature selection framework for prognostics and health management using deep neural networks |
publisher |
MDPI AG |
series |
Sensors |
issn |
1424-8220 |
publishDate |
2021-09-01 |
description |
In the last five years, the inclusion of Deep Learning algorithms in prognostics and health management (PHM) has led to a performance increase in diagnostics, prognostics, and anomaly detection. However, the lack of interpretability of these models results in resistance towards their deployment. Deep Learning-based models fall within the accuracy/interpretability tradeoff, which means that their complexity leads to high performance levels but lacks interpretability. This work aims at addressing this tradeoff by proposing a technique for feature selection embedded in deep neural networks that uses a feature selection (FS) layer trained with the rest of the network to evaluate the input features’ importance. The importance values are used to determine which will be considered for deployment of a PHM model. For comparison with other techniques, this paper introduces a new metric called ranking quality score (RQS), that measures how performance evolves while following the corresponding ranking. The proposed framework is exemplified with three case studies involving health state diagnostics and prognostics and remaining useful life prediction. Results show that the proposed technique achieves higher RQS than the compared techniques, while maintaining the same performance level when compared to the same model but without an FS layer. |
topic |
feature selection deep learning deep neural networks prognostics and health management interpretable AI |
url |
https://www.mdpi.com/1424-8220/21/17/5888 |
work_keys_str_mv |
AT joaquinfigueroabarraza towardsinterpretabledeeplearningafeatureselectionframeworkforprognosticsandhealthmanagementusingdeepneuralnetworks AT enriquelopezdroguett towardsinterpretabledeeplearningafeatureselectionframeworkforprognosticsandhealthmanagementusingdeepneuralnetworks AT marceloramosmartins towardsinterpretabledeeplearningafeatureselectionframeworkforprognosticsandhealthmanagementusingdeepneuralnetworks |
_version_ |
1717759462982287360 |