A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI

Most data-driven methods are very susceptible to data variability. This problem is particularly apparent when applying Deep Learning (DL) to brain Magnetic Resonance Imaging (MRI), where intensities and contrasts vary due to acquisition protocol, scanner- and center-specific factors. Most publicly a...

Full description

Bibliographic Details
Main Authors: Maria Ines Meyer, Ezequiel de la Rosa, Nuno Pedrosa de Barros, Roberto Paolella, Koen Van Leemput, Diana M. Sima
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-08-01
Series:Frontiers in Neuroscience
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fnins.2021.708196/full
id doaj-5f0d2a26ae5f4c04804acaa7faed7b04
record_format Article
spelling doaj-5f0d2a26ae5f4c04804acaa7faed7b042021-09-03T22:37:37ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2021-08-011510.3389/fnins.2021.708196708196A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRIMaria Ines Meyer0Maria Ines Meyer1Ezequiel de la Rosa2Ezequiel de la Rosa3Nuno Pedrosa de Barros4Roberto Paolella5Roberto Paolella6Koen Van Leemput7Koen Van Leemput8Diana M. Sima9Department of Health Technology, Technical University of Denmark, Lyngby, DenmarkIcometrix, Leuven, BelgiumIcometrix, Leuven, BelgiumDepartment of Computer Science, Technical University of Munich, Munich, GermanyIcometrix, Leuven, BelgiumIcometrix, Leuven, BelgiumImec Vision Lab, University of Antwerp, Antwerp, BelgiumDepartment of Health Technology, Technical University of Denmark, Lyngby, DenmarkMartinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, MA, United StatesIcometrix, Leuven, BelgiumMost data-driven methods are very susceptible to data variability. This problem is particularly apparent when applying Deep Learning (DL) to brain Magnetic Resonance Imaging (MRI), where intensities and contrasts vary due to acquisition protocol, scanner- and center-specific factors. Most publicly available brain MRI datasets originate from the same center and are homogeneous in terms of scanner and used protocol. As such, devising robust methods that generalize to multi-scanner and multi-center data is crucial for transferring these techniques into clinical practice. We propose a novel data augmentation approach based on Gaussian Mixture Models (GMM-DA) with the goal of increasing the variability of a given dataset in terms of intensities and contrasts. The approach allows to augment the training dataset such that the variability in the training set compares to what is seen in real world clinical data, while preserving anatomical information. We compare the performance of a state-of-the-art U-Net model trained for segmenting brain structures with and without the addition of GMM-DA. The models are trained and evaluated on single- and multi-scanner datasets. Additionally, we verify the consistency of test-retest results on same-patient images (same and different scanners). Finally, we investigate how the presence of bias field influences the performance of a model trained with GMM-DA. We found that the addition of the GMM-DA improves the generalization capability of the DL model to other scanners not present in the training data, even when the train set is already multi-scanner. Besides, the consistency between same-patient segmentation predictions is improved, both for same-scanner and different-scanner repetitions. We conclude that GMM-DA could increase the transferability of DL models into clinical scenarios.https://www.frontiersin.org/articles/10.3389/fnins.2021.708196/fullmulti-scannermagnetic resonance imagingsegmentationdata augmentationgaussian mixture models
collection DOAJ
language English
format Article
sources DOAJ
author Maria Ines Meyer
Maria Ines Meyer
Ezequiel de la Rosa
Ezequiel de la Rosa
Nuno Pedrosa de Barros
Roberto Paolella
Roberto Paolella
Koen Van Leemput
Koen Van Leemput
Diana M. Sima
spellingShingle Maria Ines Meyer
Maria Ines Meyer
Ezequiel de la Rosa
Ezequiel de la Rosa
Nuno Pedrosa de Barros
Roberto Paolella
Roberto Paolella
Koen Van Leemput
Koen Van Leemput
Diana M. Sima
A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI
Frontiers in Neuroscience
multi-scanner
magnetic resonance imaging
segmentation
data augmentation
gaussian mixture models
author_facet Maria Ines Meyer
Maria Ines Meyer
Ezequiel de la Rosa
Ezequiel de la Rosa
Nuno Pedrosa de Barros
Roberto Paolella
Roberto Paolella
Koen Van Leemput
Koen Van Leemput
Diana M. Sima
author_sort Maria Ines Meyer
title A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI
title_short A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI
title_full A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI
title_fullStr A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI
title_full_unstemmed A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI
title_sort contrast augmentation approach to improve multi-scanner generalization in mri
publisher Frontiers Media S.A.
series Frontiers in Neuroscience
issn 1662-453X
publishDate 2021-08-01
description Most data-driven methods are very susceptible to data variability. This problem is particularly apparent when applying Deep Learning (DL) to brain Magnetic Resonance Imaging (MRI), where intensities and contrasts vary due to acquisition protocol, scanner- and center-specific factors. Most publicly available brain MRI datasets originate from the same center and are homogeneous in terms of scanner and used protocol. As such, devising robust methods that generalize to multi-scanner and multi-center data is crucial for transferring these techniques into clinical practice. We propose a novel data augmentation approach based on Gaussian Mixture Models (GMM-DA) with the goal of increasing the variability of a given dataset in terms of intensities and contrasts. The approach allows to augment the training dataset such that the variability in the training set compares to what is seen in real world clinical data, while preserving anatomical information. We compare the performance of a state-of-the-art U-Net model trained for segmenting brain structures with and without the addition of GMM-DA. The models are trained and evaluated on single- and multi-scanner datasets. Additionally, we verify the consistency of test-retest results on same-patient images (same and different scanners). Finally, we investigate how the presence of bias field influences the performance of a model trained with GMM-DA. We found that the addition of the GMM-DA improves the generalization capability of the DL model to other scanners not present in the training data, even when the train set is already multi-scanner. Besides, the consistency between same-patient segmentation predictions is improved, both for same-scanner and different-scanner repetitions. We conclude that GMM-DA could increase the transferability of DL models into clinical scenarios.
topic multi-scanner
magnetic resonance imaging
segmentation
data augmentation
gaussian mixture models
url https://www.frontiersin.org/articles/10.3389/fnins.2021.708196/full
work_keys_str_mv AT mariainesmeyer acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT mariainesmeyer acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT ezequieldelarosa acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT ezequieldelarosa acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT nunopedrosadebarros acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT robertopaolella acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT robertopaolella acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT koenvanleemput acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT koenvanleemput acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT dianamsima acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT mariainesmeyer contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT mariainesmeyer contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT ezequieldelarosa contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT ezequieldelarosa contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT nunopedrosadebarros contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT robertopaolella contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT robertopaolella contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT koenvanleemput contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT koenvanleemput contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
AT dianamsima contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri
_version_ 1717815800521293824