Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal Data

Subtype and Stage Inference (SuStaIn) is an unsupervised learning algorithm that uniquely enables the identification of subgroups of individuals with distinct pseudo-temporal disease progression patterns from cross-sectional datasets. SuStaIn has been used to identify data-driven subgroups and perfo...

Full description

Bibliographic Details
Main Authors: Alexandra L. Young, Jacob W. Vogel, Leon M. Aksman, Peter A. Wijeratne, Arman Eshaghi, Neil P. Oxtoby, Steven C. R. Williams, Daniel C. Alexander, for the Alzheimer’s Disease Neuroimaging Initiative
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-08-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2021.613261/full
id doaj-11c2cf5e6fee431b965b5689367f6fe7
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Alexandra L. Young
Alexandra L. Young
Alexandra L. Young
Jacob W. Vogel
Jacob W. Vogel
Leon M. Aksman
Peter A. Wijeratne
Peter A. Wijeratne
Arman Eshaghi
Arman Eshaghi
Neil P. Oxtoby
Neil P. Oxtoby
Steven C. R. Williams
Daniel C. Alexander
Daniel C. Alexander
for the Alzheimer’s Disease Neuroimaging Initiative
spellingShingle Alexandra L. Young
Alexandra L. Young
Alexandra L. Young
Jacob W. Vogel
Jacob W. Vogel
Leon M. Aksman
Peter A. Wijeratne
Peter A. Wijeratne
Arman Eshaghi
Arman Eshaghi
Neil P. Oxtoby
Neil P. Oxtoby
Steven C. R. Williams
Daniel C. Alexander
Daniel C. Alexander
for the Alzheimer’s Disease Neuroimaging Initiative
Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal Data
Frontiers in Artificial Intelligence
subtyping
staging
Alzheimer’s disease
disease progression modelling
ordinal data
author_facet Alexandra L. Young
Alexandra L. Young
Alexandra L. Young
Jacob W. Vogel
Jacob W. Vogel
Leon M. Aksman
Peter A. Wijeratne
Peter A. Wijeratne
Arman Eshaghi
Arman Eshaghi
Neil P. Oxtoby
Neil P. Oxtoby
Steven C. R. Williams
Daniel C. Alexander
Daniel C. Alexander
for the Alzheimer’s Disease Neuroimaging Initiative
author_sort Alexandra L. Young
title Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal Data
title_short Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal Data
title_full Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal Data
title_fullStr Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal Data
title_full_unstemmed Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal Data
title_sort ordinal sustain: subtype and stage inference for clinical scores, visual ratings, and other ordinal data
publisher Frontiers Media S.A.
series Frontiers in Artificial Intelligence
issn 2624-8212
publishDate 2021-08-01
description Subtype and Stage Inference (SuStaIn) is an unsupervised learning algorithm that uniquely enables the identification of subgroups of individuals with distinct pseudo-temporal disease progression patterns from cross-sectional datasets. SuStaIn has been used to identify data-driven subgroups and perform patient stratification in neurodegenerative diseases and in lung diseases from continuous biomarker measurements predominantly obtained from imaging. However, the SuStaIn algorithm is not currently applicable to discrete ordinal data, such as visual ratings of images, neuropathological ratings, and clinical and neuropsychological test scores, restricting the applicability of SuStaIn to a narrower range of settings. Here we propose ‘Ordinal SuStaIn’, an ordinal version of the SuStaIn algorithm that uses a scored events model of disease progression to enable the application of SuStaIn to ordinal data. We demonstrate the validity of Ordinal SuStaIn by benchmarking the performance of the algorithm on simulated data. We further demonstrate that Ordinal SuStaIn out-performs the existing continuous version of SuStaIn (Z-score SuStaIn) on discrete scored data, providing much more accurate subtype progression patterns, better subtyping and staging of individuals, and accurate uncertainty estimates. We then apply Ordinal SuStaIn to six different sub-scales of the Clinical Dementia Rating scale (CDR) using data from the Alzheimer’s disease Neuroimaging Initiative (ADNI) study to identify individuals with distinct patterns of functional decline. Using data from 819 ADNI1 participants we identified three distinct CDR subtype progression patterns, which were independently verified using data from 790 ADNI2 participants. Our results provide insight into patterns of decline in daily activities in Alzheimer’s disease and a mechanism for stratifying individuals into groups with difficulties in different domains. Ordinal SuStaIn is broadly applicable across different types of ratings data, including visual ratings from imaging, neuropathological ratings and clinical or behavioural ratings data.
topic subtyping
staging
Alzheimer’s disease
disease progression modelling
ordinal data
url https://www.frontiersin.org/articles/10.3389/frai.2021.613261/full
work_keys_str_mv AT alexandralyoung ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT alexandralyoung ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT alexandralyoung ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT jacobwvogel ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT jacobwvogel ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT leonmaksman ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT peterawijeratne ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT peterawijeratne ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT armaneshaghi ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT armaneshaghi ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT neilpoxtoby ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT neilpoxtoby ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT stevencrwilliams ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT danielcalexander ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT danielcalexander ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
AT forthealzheimersdiseaseneuroimaginginitiative ordinalsustainsubtypeandstageinferenceforclinicalscoresvisualratingsandotherordinaldata
_version_ 1721209735112294400
spelling doaj-11c2cf5e6fee431b965b5689367f6fe72021-08-12T04:51:21ZengFrontiers Media S.A.Frontiers in Artificial Intelligence2624-82122021-08-01410.3389/frai.2021.613261613261Ordinal SuStaIn: Subtype and Stage Inference for Clinical Scores, Visual Ratings, and Other Ordinal DataAlexandra L. Young0Alexandra L. Young1Alexandra L. Young2Jacob W. Vogel3Jacob W. Vogel4Leon M. Aksman5Peter A. Wijeratne6Peter A. Wijeratne7Arman Eshaghi8Arman Eshaghi9Neil P. Oxtoby10Neil P. Oxtoby11Steven C. R. Williams12Daniel C. Alexander13Daniel C. Alexander14for the Alzheimer’s Disease Neuroimaging InitiativeDepartment of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United KingdomCentre for Medical Image Computing, University College London, London, United KingdomDepartment of Computer Science, University College London, London, United KingdomDepartment of Psychiatry, University of Pennsylvania, Philadelphia, PA, Unites StatesCenter for Biomedical Image Computing and Analytics, University of Pennsylvania, Philadelphia, PA, Unites StatesStevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA, Unites StatesCentre for Medical Image Computing, University College London, London, United KingdomDepartment of Computer Science, University College London, London, United KingdomDepartment of Computer Science, University College London, London, United KingdomQueen Square Multiple Sclerosis Centre, Department of Neuroinflammation, Faculty of Brain Sciences, UCL Queen Square Institute of Neurology, University College London, London, United KingdomCentre for Medical Image Computing, University College London, London, United KingdomDepartment of Computer Science, University College London, London, United KingdomDepartment of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King’s College London, London, United KingdomCentre for Medical Image Computing, University College London, London, United KingdomDepartment of Computer Science, University College London, London, United KingdomSubtype and Stage Inference (SuStaIn) is an unsupervised learning algorithm that uniquely enables the identification of subgroups of individuals with distinct pseudo-temporal disease progression patterns from cross-sectional datasets. SuStaIn has been used to identify data-driven subgroups and perform patient stratification in neurodegenerative diseases and in lung diseases from continuous biomarker measurements predominantly obtained from imaging. However, the SuStaIn algorithm is not currently applicable to discrete ordinal data, such as visual ratings of images, neuropathological ratings, and clinical and neuropsychological test scores, restricting the applicability of SuStaIn to a narrower range of settings. Here we propose ‘Ordinal SuStaIn’, an ordinal version of the SuStaIn algorithm that uses a scored events model of disease progression to enable the application of SuStaIn to ordinal data. We demonstrate the validity of Ordinal SuStaIn by benchmarking the performance of the algorithm on simulated data. We further demonstrate that Ordinal SuStaIn out-performs the existing continuous version of SuStaIn (Z-score SuStaIn) on discrete scored data, providing much more accurate subtype progression patterns, better subtyping and staging of individuals, and accurate uncertainty estimates. We then apply Ordinal SuStaIn to six different sub-scales of the Clinical Dementia Rating scale (CDR) using data from the Alzheimer’s disease Neuroimaging Initiative (ADNI) study to identify individuals with distinct patterns of functional decline. Using data from 819 ADNI1 participants we identified three distinct CDR subtype progression patterns, which were independently verified using data from 790 ADNI2 participants. Our results provide insight into patterns of decline in daily activities in Alzheimer’s disease and a mechanism for stratifying individuals into groups with difficulties in different domains. Ordinal SuStaIn is broadly applicable across different types of ratings data, including visual ratings from imaging, neuropathological ratings and clinical or behavioural ratings data.https://www.frontiersin.org/articles/10.3389/frai.2021.613261/fullsubtypingstagingAlzheimer’s diseasedisease progression modellingordinal data