Evaluation of machine learning algorithms and structural features for optimal MRI-based diagnostic prediction in psychosis.

A relatively large number of studies have investigated the power of structural magnetic resonance imaging (sMRI) data to discriminate patients with schizophrenia from healthy controls. However, very few of them have also included patients with bipolar disorder, allowing the clinically relevant discr...

Full description

Bibliographic Details
Main Authors: Raymond Salvador, Joaquim Radua, Erick J Canales-Rodríguez, Aleix Solanes, Salvador Sarró, José M Goikolea, Alicia Valiente, Gemma C Monté, María Del Carmen Natividad, Amalia Guerrero-Pedraza, Noemí Moro, Paloma Fernández-Corcuera, Benedikt L Amann, Teresa Maristany, Eduard Vieta, Peter J McKenna, Edith Pomarol-Clotet
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2017-01-01
Series:PLoS ONE
Online Access:http://europepmc.org/articles/PMC5398548?pdf=render
id doaj-ba90e241a26a400091c09c7242e86cef
record_format Article
spelling doaj-ba90e241a26a400091c09c7242e86cef2020-11-24T21:09:54ZengPublic Library of Science (PLoS)PLoS ONE1932-62032017-01-01124e017568310.1371/journal.pone.0175683Evaluation of machine learning algorithms and structural features for optimal MRI-based diagnostic prediction in psychosis.Raymond SalvadorJoaquim RaduaErick J Canales-RodríguezAleix SolanesSalvador SarróJosé M GoikoleaAlicia ValienteGemma C MontéMaría Del Carmen NatividadAmalia Guerrero-PedrazaNoemí MoroPaloma Fernández-CorcueraBenedikt L AmannTeresa MaristanyEduard VietaPeter J McKennaEdith Pomarol-ClotetA relatively large number of studies have investigated the power of structural magnetic resonance imaging (sMRI) data to discriminate patients with schizophrenia from healthy controls. However, very few of them have also included patients with bipolar disorder, allowing the clinically relevant discrimination between both psychotic diagnostics. To assess the efficacy of sMRI data for diagnostic prediction in psychosis we objectively evaluated the discriminative power of a wide range of commonly used machine learning algorithms (ridge, lasso, elastic net and L0 norm regularized logistic regressions, a support vector classifier, regularized discriminant analysis, random forests and a Gaussian process classifier) on main sMRI features including grey and white matter voxel-based morphometry (VBM), vertex-based cortical thickness and volume, region of interest volumetric measures and wavelet-based morphometry (WBM) maps. All possible combinations of algorithms and data features were considered in pairwise classifications of matched samples of healthy controls (N = 127), patients with schizophrenia (N = 128) and patients with bipolar disorder (N = 128). Results show that the selection of feature type is important, with grey matter VBM (without data reduction) delivering the best diagnostic prediction rates (averaging over classifiers: schizophrenia vs. healthy 75%, bipolar disorder vs. healthy 63% and schizophrenia vs. bipolar disorder 62%) whereas algorithms usually yielded very similar results. Indeed, those grey matter VBM accuracy rates were not even improved by combining all feature types in a single prediction model. Further multi-class classifications considering the three groups simultaneously made evident a lack of predictive power for the bipolar group, probably due to its intermediate anatomical features, located between those observed in healthy controls and those found in patients with schizophrenia. Finally, we provide MRIPredict (https://www.nitrc.org/projects/mripredict/), a free tool for SPM, FSL and R, to easily carry out voxelwise predictions based on VBM images.http://europepmc.org/articles/PMC5398548?pdf=render
collection DOAJ
language English
format Article
sources DOAJ
author Raymond Salvador
Joaquim Radua
Erick J Canales-Rodríguez
Aleix Solanes
Salvador Sarró
José M Goikolea
Alicia Valiente
Gemma C Monté
María Del Carmen Natividad
Amalia Guerrero-Pedraza
Noemí Moro
Paloma Fernández-Corcuera
Benedikt L Amann
Teresa Maristany
Eduard Vieta
Peter J McKenna
Edith Pomarol-Clotet
spellingShingle Raymond Salvador
Joaquim Radua
Erick J Canales-Rodríguez
Aleix Solanes
Salvador Sarró
José M Goikolea
Alicia Valiente
Gemma C Monté
María Del Carmen Natividad
Amalia Guerrero-Pedraza
Noemí Moro
Paloma Fernández-Corcuera
Benedikt L Amann
Teresa Maristany
Eduard Vieta
Peter J McKenna
Edith Pomarol-Clotet
Evaluation of machine learning algorithms and structural features for optimal MRI-based diagnostic prediction in psychosis.
PLoS ONE
author_facet Raymond Salvador
Joaquim Radua
Erick J Canales-Rodríguez
Aleix Solanes
Salvador Sarró
José M Goikolea
Alicia Valiente
Gemma C Monté
María Del Carmen Natividad
Amalia Guerrero-Pedraza
Noemí Moro
Paloma Fernández-Corcuera
Benedikt L Amann
Teresa Maristany
Eduard Vieta
Peter J McKenna
Edith Pomarol-Clotet
author_sort Raymond Salvador
title Evaluation of machine learning algorithms and structural features for optimal MRI-based diagnostic prediction in psychosis.
title_short Evaluation of machine learning algorithms and structural features for optimal MRI-based diagnostic prediction in psychosis.
title_full Evaluation of machine learning algorithms and structural features for optimal MRI-based diagnostic prediction in psychosis.
title_fullStr Evaluation of machine learning algorithms and structural features for optimal MRI-based diagnostic prediction in psychosis.
title_full_unstemmed Evaluation of machine learning algorithms and structural features for optimal MRI-based diagnostic prediction in psychosis.
title_sort evaluation of machine learning algorithms and structural features for optimal mri-based diagnostic prediction in psychosis.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2017-01-01
description A relatively large number of studies have investigated the power of structural magnetic resonance imaging (sMRI) data to discriminate patients with schizophrenia from healthy controls. However, very few of them have also included patients with bipolar disorder, allowing the clinically relevant discrimination between both psychotic diagnostics. To assess the efficacy of sMRI data for diagnostic prediction in psychosis we objectively evaluated the discriminative power of a wide range of commonly used machine learning algorithms (ridge, lasso, elastic net and L0 norm regularized logistic regressions, a support vector classifier, regularized discriminant analysis, random forests and a Gaussian process classifier) on main sMRI features including grey and white matter voxel-based morphometry (VBM), vertex-based cortical thickness and volume, region of interest volumetric measures and wavelet-based morphometry (WBM) maps. All possible combinations of algorithms and data features were considered in pairwise classifications of matched samples of healthy controls (N = 127), patients with schizophrenia (N = 128) and patients with bipolar disorder (N = 128). Results show that the selection of feature type is important, with grey matter VBM (without data reduction) delivering the best diagnostic prediction rates (averaging over classifiers: schizophrenia vs. healthy 75%, bipolar disorder vs. healthy 63% and schizophrenia vs. bipolar disorder 62%) whereas algorithms usually yielded very similar results. Indeed, those grey matter VBM accuracy rates were not even improved by combining all feature types in a single prediction model. Further multi-class classifications considering the three groups simultaneously made evident a lack of predictive power for the bipolar group, probably due to its intermediate anatomical features, located between those observed in healthy controls and those found in patients with schizophrenia. Finally, we provide MRIPredict (https://www.nitrc.org/projects/mripredict/), a free tool for SPM, FSL and R, to easily carry out voxelwise predictions based on VBM images.
url http://europepmc.org/articles/PMC5398548?pdf=render
work_keys_str_mv AT raymondsalvador evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT joaquimradua evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT erickjcanalesrodriguez evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT aleixsolanes evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT salvadorsarro evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT josemgoikolea evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT aliciavaliente evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT gemmacmonte evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT mariadelcarmennatividad evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT amaliaguerreropedraza evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT noemimoro evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT palomafernandezcorcuera evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT benediktlamann evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT teresamaristany evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT eduardvieta evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT peterjmckenna evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
AT edithpomarolclotet evaluationofmachinelearningalgorithmsandstructuralfeaturesforoptimalmribaseddiagnosticpredictioninpsychosis
_version_ 1716757120507969536