Shape Information Improves the Cross-Cohort Performance of Deep Learning-Based Segmentation of the Hippocampus

Performing an accurate segmentation of the hippocampus from brain magnetic resonance images is a crucial task in neuroimaging research, since its structural integrity is strongly related to several neurodegenerative disorders, including Alzheimer’s disease (AD). Some automatic segmentation tools are...

Full description

Bibliographic Details
Main Authors: Irene Brusini, Olof Lindberg, J-Sebastian Muehlboeck, Örjan Smedby, Eric Westman, Chunliang Wang
Format: Article
Language:English
Published: Frontiers Media S.A. 2020-01-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/article/10.3389/fnins.2020.00015/full
id doaj-3c5a4996a561457196029d82fe6a7d6f
record_format Article
spelling doaj-3c5a4996a561457196029d82fe6a7d6f2020-11-25T01:21:30ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2020-01-011410.3389/fnins.2020.00015469755Shape Information Improves the Cross-Cohort Performance of Deep Learning-Based Segmentation of the HippocampusIrene Brusini0Irene Brusini1Olof Lindberg2J-Sebastian Muehlboeck3Örjan Smedby4Eric Westman5Chunliang Wang6Division of Biomedical Imaging, Department of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Stockholm, SwedenDivision of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institute, Solna, SwedenDivision of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institute, Solna, SwedenDivision of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institute, Solna, SwedenDivision of Biomedical Imaging, Department of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Stockholm, SwedenDivision of Clinical Geriatrics, Department of Neurobiology, Care Sciences and Society, Karolinska Institute, Solna, SwedenDivision of Biomedical Imaging, Department of Biomedical Engineering and Health Systems, KTH Royal Institute of Technology, Stockholm, SwedenPerforming an accurate segmentation of the hippocampus from brain magnetic resonance images is a crucial task in neuroimaging research, since its structural integrity is strongly related to several neurodegenerative disorders, including Alzheimer’s disease (AD). Some automatic segmentation tools are already being used, but, in recent years, new deep learning (DL)-based methods have been proven to be much more accurate in various medical image segmentation tasks. In this work, we propose a DL-based hippocampus segmentation framework that embeds statistical shape of the hippocampus as context information into the deep neural network (DNN). The inclusion of shape information is achieved with three main steps: (1) a U-Net-based segmentation, (2) a shape model estimation, and (3) a second U-Net-based segmentation which uses both the original input data and the fitted shape model. The trained DL architectures were tested on image data of three diagnostic groups [AD patients, subjects with mild cognitive impairment (MCI) and controls] from two cohorts (ADNI and AddNeuroMed). Both intra-cohort validation and cross-cohort validation were performed and compared with the conventional U-net architecture and some variations with other types of context information (i.e., autocontext and tissue-class context). Our results suggest that adding shape information can improve the segmentation accuracy in cross-cohort validation, i.e., when DNNs are trained on one cohort and applied to another. However, no significant benefit is observed in intra-cohort validation, i.e., training and testing DNNs on images from the same cohort. Moreover, compared to other types of context information, the use of shape context was shown to be the most successful in increasing the accuracy, while keeping the computational time in the order of a few minutes.https://www.frontiersin.org/article/10.3389/fnins.2020.00015/fullhippocampusbrain MRIAlzheimer’s diseaseimage segmentationdeep learningstatistical shape model
collection DOAJ
language English
format Article
sources DOAJ
author Irene Brusini
Irene Brusini
Olof Lindberg
J-Sebastian Muehlboeck
Örjan Smedby
Eric Westman
Chunliang Wang
spellingShingle Irene Brusini
Irene Brusini
Olof Lindberg
J-Sebastian Muehlboeck
Örjan Smedby
Eric Westman
Chunliang Wang
Shape Information Improves the Cross-Cohort Performance of Deep Learning-Based Segmentation of the Hippocampus
Frontiers in Neuroscience
hippocampus
brain MRI
Alzheimer’s disease
image segmentation
deep learning
statistical shape model
author_facet Irene Brusini
Irene Brusini
Olof Lindberg
J-Sebastian Muehlboeck
Örjan Smedby
Eric Westman
Chunliang Wang
author_sort Irene Brusini
title Shape Information Improves the Cross-Cohort Performance of Deep Learning-Based Segmentation of the Hippocampus
title_short Shape Information Improves the Cross-Cohort Performance of Deep Learning-Based Segmentation of the Hippocampus
title_full Shape Information Improves the Cross-Cohort Performance of Deep Learning-Based Segmentation of the Hippocampus
title_fullStr Shape Information Improves the Cross-Cohort Performance of Deep Learning-Based Segmentation of the Hippocampus
title_full_unstemmed Shape Information Improves the Cross-Cohort Performance of Deep Learning-Based Segmentation of the Hippocampus
title_sort shape information improves the cross-cohort performance of deep learning-based segmentation of the hippocampus
publisher Frontiers Media S.A.
series Frontiers in Neuroscience
issn 1662-453X
publishDate 2020-01-01
description Performing an accurate segmentation of the hippocampus from brain magnetic resonance images is a crucial task in neuroimaging research, since its structural integrity is strongly related to several neurodegenerative disorders, including Alzheimer’s disease (AD). Some automatic segmentation tools are already being used, but, in recent years, new deep learning (DL)-based methods have been proven to be much more accurate in various medical image segmentation tasks. In this work, we propose a DL-based hippocampus segmentation framework that embeds statistical shape of the hippocampus as context information into the deep neural network (DNN). The inclusion of shape information is achieved with three main steps: (1) a U-Net-based segmentation, (2) a shape model estimation, and (3) a second U-Net-based segmentation which uses both the original input data and the fitted shape model. The trained DL architectures were tested on image data of three diagnostic groups [AD patients, subjects with mild cognitive impairment (MCI) and controls] from two cohorts (ADNI and AddNeuroMed). Both intra-cohort validation and cross-cohort validation were performed and compared with the conventional U-net architecture and some variations with other types of context information (i.e., autocontext and tissue-class context). Our results suggest that adding shape information can improve the segmentation accuracy in cross-cohort validation, i.e., when DNNs are trained on one cohort and applied to another. However, no significant benefit is observed in intra-cohort validation, i.e., training and testing DNNs on images from the same cohort. Moreover, compared to other types of context information, the use of shape context was shown to be the most successful in increasing the accuracy, while keeping the computational time in the order of a few minutes.
topic hippocampus
brain MRI
Alzheimer’s disease
image segmentation
deep learning
statistical shape model
url https://www.frontiersin.org/article/10.3389/fnins.2020.00015/full
work_keys_str_mv AT irenebrusini shapeinformationimprovesthecrosscohortperformanceofdeeplearningbasedsegmentationofthehippocampus
AT irenebrusini shapeinformationimprovesthecrosscohortperformanceofdeeplearningbasedsegmentationofthehippocampus
AT oloflindberg shapeinformationimprovesthecrosscohortperformanceofdeeplearningbasedsegmentationofthehippocampus
AT jsebastianmuehlboeck shapeinformationimprovesthecrosscohortperformanceofdeeplearningbasedsegmentationofthehippocampus
AT orjansmedby shapeinformationimprovesthecrosscohortperformanceofdeeplearningbasedsegmentationofthehippocampus
AT ericwestman shapeinformationimprovesthecrosscohortperformanceofdeeplearningbasedsegmentationofthehippocampus
AT chunliangwang shapeinformationimprovesthecrosscohortperformanceofdeeplearningbasedsegmentationofthehippocampus
_version_ 1725129858991783936