A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI
Most data-driven methods are very susceptible to data variability. This problem is particularly apparent when applying Deep Learning (DL) to brain Magnetic Resonance Imaging (MRI), where intensities and contrasts vary due to acquisition protocol, scanner- and center-specific factors. Most publicly a...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Frontiers Media S.A.
2021-08-01
|
Series: | Frontiers in Neuroscience |
Subjects: | |
Online Access: | https://www.frontiersin.org/articles/10.3389/fnins.2021.708196/full |
id |
doaj-5f0d2a26ae5f4c04804acaa7faed7b04 |
---|---|
record_format |
Article |
spelling |
doaj-5f0d2a26ae5f4c04804acaa7faed7b042021-09-03T22:37:37ZengFrontiers Media S.A.Frontiers in Neuroscience1662-453X2021-08-011510.3389/fnins.2021.708196708196A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRIMaria Ines Meyer0Maria Ines Meyer1Ezequiel de la Rosa2Ezequiel de la Rosa3Nuno Pedrosa de Barros4Roberto Paolella5Roberto Paolella6Koen Van Leemput7Koen Van Leemput8Diana M. Sima9Department of Health Technology, Technical University of Denmark, Lyngby, DenmarkIcometrix, Leuven, BelgiumIcometrix, Leuven, BelgiumDepartment of Computer Science, Technical University of Munich, Munich, GermanyIcometrix, Leuven, BelgiumIcometrix, Leuven, BelgiumImec Vision Lab, University of Antwerp, Antwerp, BelgiumDepartment of Health Technology, Technical University of Denmark, Lyngby, DenmarkMartinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, MA, United StatesIcometrix, Leuven, BelgiumMost data-driven methods are very susceptible to data variability. This problem is particularly apparent when applying Deep Learning (DL) to brain Magnetic Resonance Imaging (MRI), where intensities and contrasts vary due to acquisition protocol, scanner- and center-specific factors. Most publicly available brain MRI datasets originate from the same center and are homogeneous in terms of scanner and used protocol. As such, devising robust methods that generalize to multi-scanner and multi-center data is crucial for transferring these techniques into clinical practice. We propose a novel data augmentation approach based on Gaussian Mixture Models (GMM-DA) with the goal of increasing the variability of a given dataset in terms of intensities and contrasts. The approach allows to augment the training dataset such that the variability in the training set compares to what is seen in real world clinical data, while preserving anatomical information. We compare the performance of a state-of-the-art U-Net model trained for segmenting brain structures with and without the addition of GMM-DA. The models are trained and evaluated on single- and multi-scanner datasets. Additionally, we verify the consistency of test-retest results on same-patient images (same and different scanners). Finally, we investigate how the presence of bias field influences the performance of a model trained with GMM-DA. We found that the addition of the GMM-DA improves the generalization capability of the DL model to other scanners not present in the training data, even when the train set is already multi-scanner. Besides, the consistency between same-patient segmentation predictions is improved, both for same-scanner and different-scanner repetitions. We conclude that GMM-DA could increase the transferability of DL models into clinical scenarios.https://www.frontiersin.org/articles/10.3389/fnins.2021.708196/fullmulti-scannermagnetic resonance imagingsegmentationdata augmentationgaussian mixture models |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Maria Ines Meyer Maria Ines Meyer Ezequiel de la Rosa Ezequiel de la Rosa Nuno Pedrosa de Barros Roberto Paolella Roberto Paolella Koen Van Leemput Koen Van Leemput Diana M. Sima |
spellingShingle |
Maria Ines Meyer Maria Ines Meyer Ezequiel de la Rosa Ezequiel de la Rosa Nuno Pedrosa de Barros Roberto Paolella Roberto Paolella Koen Van Leemput Koen Van Leemput Diana M. Sima A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI Frontiers in Neuroscience multi-scanner magnetic resonance imaging segmentation data augmentation gaussian mixture models |
author_facet |
Maria Ines Meyer Maria Ines Meyer Ezequiel de la Rosa Ezequiel de la Rosa Nuno Pedrosa de Barros Roberto Paolella Roberto Paolella Koen Van Leemput Koen Van Leemput Diana M. Sima |
author_sort |
Maria Ines Meyer |
title |
A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI |
title_short |
A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI |
title_full |
A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI |
title_fullStr |
A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI |
title_full_unstemmed |
A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI |
title_sort |
contrast augmentation approach to improve multi-scanner generalization in mri |
publisher |
Frontiers Media S.A. |
series |
Frontiers in Neuroscience |
issn |
1662-453X |
publishDate |
2021-08-01 |
description |
Most data-driven methods are very susceptible to data variability. This problem is particularly apparent when applying Deep Learning (DL) to brain Magnetic Resonance Imaging (MRI), where intensities and contrasts vary due to acquisition protocol, scanner- and center-specific factors. Most publicly available brain MRI datasets originate from the same center and are homogeneous in terms of scanner and used protocol. As such, devising robust methods that generalize to multi-scanner and multi-center data is crucial for transferring these techniques into clinical practice. We propose a novel data augmentation approach based on Gaussian Mixture Models (GMM-DA) with the goal of increasing the variability of a given dataset in terms of intensities and contrasts. The approach allows to augment the training dataset such that the variability in the training set compares to what is seen in real world clinical data, while preserving anatomical information. We compare the performance of a state-of-the-art U-Net model trained for segmenting brain structures with and without the addition of GMM-DA. The models are trained and evaluated on single- and multi-scanner datasets. Additionally, we verify the consistency of test-retest results on same-patient images (same and different scanners). Finally, we investigate how the presence of bias field influences the performance of a model trained with GMM-DA. We found that the addition of the GMM-DA improves the generalization capability of the DL model to other scanners not present in the training data, even when the train set is already multi-scanner. Besides, the consistency between same-patient segmentation predictions is improved, both for same-scanner and different-scanner repetitions. We conclude that GMM-DA could increase the transferability of DL models into clinical scenarios. |
topic |
multi-scanner magnetic resonance imaging segmentation data augmentation gaussian mixture models |
url |
https://www.frontiersin.org/articles/10.3389/fnins.2021.708196/full |
work_keys_str_mv |
AT mariainesmeyer acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT mariainesmeyer acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT ezequieldelarosa acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT ezequieldelarosa acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT nunopedrosadebarros acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT robertopaolella acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT robertopaolella acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT koenvanleemput acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT koenvanleemput acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT dianamsima acontrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT mariainesmeyer contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT mariainesmeyer contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT ezequieldelarosa contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT ezequieldelarosa contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT nunopedrosadebarros contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT robertopaolella contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT robertopaolella contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT koenvanleemput contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT koenvanleemput contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri AT dianamsima contrastaugmentationapproachtoimprovemultiscannergeneralizationinmri |
_version_ |
1717815800521293824 |