Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation
Background and Objectives Deep neural networks recently become a popular tool in medical research to predict disease progression and unveil its underlying temporal phenotypes. While being well suited to study longitudinal clinical data and learn disease progression models, its application in clinica...
Main Authors: | , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Elsevier
2021-01-01
|
Series: | Computer Methods and Programs in Biomedicine Update |
Subjects: | |
Online Access: | http://www.sciencedirect.com/science/article/pii/S2666990021000173 |
id |
doaj-4b2a00b3f7654a6ba5bb7424e54dbcf6 |
---|---|
record_format |
Article |
spelling |
doaj-4b2a00b3f7654a6ba5bb7424e54dbcf62021-07-15T04:28:47ZengElsevierComputer Methods and Programs in Biomedicine Update2666-99002021-01-011100018Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanationMarcel Müller0Marta Gromicho1Mamede de Carvalho2Sara C. Madeira3Technische Universität Berlin and Telekom Innovation Laboratories, Berlin, GermanyInstituto de Medicina Molecular, Faculdade de Medicina, Universidade de Lisboa, Lisbon, PortugalInstituto de Medicina Molecular, Faculdade de Medicina, Universidade de Lisboa, Lisbon, Portugal; Department of Neurosciences and Mental Health, Centro Hospitalar Universitário de Lisboa-Norte, Lisbon, PortugalCorresponding author. LASIGE, Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, 1749-016 Lisboa, Portugal.; LASIGE, Faculdade de Ciências, Universidade de Lisboa, Lisbon, PortugalBackground and Objectives Deep neural networks recently become a popular tool in medical research to predict disease progression and unveil its underlying temporal phenotypes. While being well suited to study longitudinal clinical data and learn disease progression models, its application in clinical setting is challenged by the importance of model explainability. In this work, we integrate model learning using recurrent neural networks with deep model explanation using SHAP to study disease progression in Amyotrophic Lateral Sclerosis (ALS).Methods We propose and evaluate different deep neural networks to predict disease progression in a large cohort of Portuguese ALS patients. We learn models of disease progression targeting the prediction and explanation of respiratory decline to respiratory failure, as measured by clinical administration of non-invasive ventilation (NIV). Afterward, we explain the learnt models using SHAP and inspect the outcome with clinical researchers, targeting the identification of highly influencing features in model prediction, and putative features to be discarded in an augmented model, due to their small influence.Results When used to predict breathing capability of ALS patients in different time windows, our recurrent neural networks with LSTMs (Long Short-Term Memory) showed mean squared errors below 0.01 and 0.02 in train and test, respectively. This enables their effective use to predict the need for non-invasive ventilation, and potentially other clinically relevant endpoints, while providing clinical insights regarding disease progression to respiratory insufficiency. It was exciting to find that this study supports previous results showing that neck weakness is related to disease outcome and respiratory decline in ALS.Conclusions Our study to learn and explain a predictive model for ALS shows the potentialities of using deep learning from longitudinal clinical data together with deep model explanation to achieve accurate prognostic prediction and model interpretability, while drawing insights into disease progression and promoting personalized medicine.http://www.sciencedirect.com/science/article/pii/S2666990021000173Explainable modelsLongitudinal dataDisease progressionPrognostic predictionAmyotrophic lateral sclerosisALSFRS-R |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Marcel Müller Marta Gromicho Mamede de Carvalho Sara C. Madeira |
spellingShingle |
Marcel Müller Marta Gromicho Mamede de Carvalho Sara C. Madeira Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation Computer Methods and Programs in Biomedicine Update Explainable models Longitudinal data Disease progression Prognostic prediction Amyotrophic lateral sclerosis ALSFRS-R |
author_facet |
Marcel Müller Marta Gromicho Mamede de Carvalho Sara C. Madeira |
author_sort |
Marcel Müller |
title |
Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation |
title_short |
Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation |
title_full |
Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation |
title_fullStr |
Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation |
title_full_unstemmed |
Explainable models of disease progression in ALS: Learning from longitudinal clinical data with recurrent neural networks and deep model explanation |
title_sort |
explainable models of disease progression in als: learning from longitudinal clinical data with recurrent neural networks and deep model explanation |
publisher |
Elsevier |
series |
Computer Methods and Programs in Biomedicine Update |
issn |
2666-9900 |
publishDate |
2021-01-01 |
description |
Background and Objectives Deep neural networks recently become a popular tool in medical research to predict disease progression and unveil its underlying temporal phenotypes. While being well suited to study longitudinal clinical data and learn disease progression models, its application in clinical setting is challenged by the importance of model explainability. In this work, we integrate model learning using recurrent neural networks with deep model explanation using SHAP to study disease progression in Amyotrophic Lateral Sclerosis (ALS).Methods We propose and evaluate different deep neural networks to predict disease progression in a large cohort of Portuguese ALS patients. We learn models of disease progression targeting the prediction and explanation of respiratory decline to respiratory failure, as measured by clinical administration of non-invasive ventilation (NIV). Afterward, we explain the learnt models using SHAP and inspect the outcome with clinical researchers, targeting the identification of highly influencing features in model prediction, and putative features to be discarded in an augmented model, due to their small influence.Results When used to predict breathing capability of ALS patients in different time windows, our recurrent neural networks with LSTMs (Long Short-Term Memory) showed mean squared errors below 0.01 and 0.02 in train and test, respectively. This enables their effective use to predict the need for non-invasive ventilation, and potentially other clinically relevant endpoints, while providing clinical insights regarding disease progression to respiratory insufficiency. It was exciting to find that this study supports previous results showing that neck weakness is related to disease outcome and respiratory decline in ALS.Conclusions Our study to learn and explain a predictive model for ALS shows the potentialities of using deep learning from longitudinal clinical data together with deep model explanation to achieve accurate prognostic prediction and model interpretability, while drawing insights into disease progression and promoting personalized medicine. |
topic |
Explainable models Longitudinal data Disease progression Prognostic prediction Amyotrophic lateral sclerosis ALSFRS-R |
url |
http://www.sciencedirect.com/science/article/pii/S2666990021000173 |
work_keys_str_mv |
AT marcelmuller explainablemodelsofdiseaseprogressioninalslearningfromlongitudinalclinicaldatawithrecurrentneuralnetworksanddeepmodelexplanation AT martagromicho explainablemodelsofdiseaseprogressioninalslearningfromlongitudinalclinicaldatawithrecurrentneuralnetworksanddeepmodelexplanation AT mamededecarvalho explainablemodelsofdiseaseprogressioninalslearningfromlongitudinalclinicaldatawithrecurrentneuralnetworksanddeepmodelexplanation AT saracmadeira explainablemodelsofdiseaseprogressioninalslearningfromlongitudinalclinicaldatawithrecurrentneuralnetworksanddeepmodelexplanation |
_version_ |
1721301866767187968 |