Inter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter study

Abstract There is little evidence on the applicability of deep learning (DL) in the segmentation of acute ischemic lesions on diffusion-weighted imaging (DWI) between magnetic resonance imaging (MRI) scanners of different manufacturers. We retrospectively included DWI data of patients with acute isc...

Full description

Bibliographic Details
Main Authors: Deniz Alis, Mert Yergin, Ceren Alis, Cagdas Topel, Ozan Asmakutlu, Omer Bagcilar, Yeseren Deniz Senli, Ahmet Ustundag, Vefa Salt, Sebahat Nacar Dogan, Murat Velioglu, Hakan Hatem Selcuk, Batuhan Kara, Ilkay Oksuz, Osman Kizilkilic, Ercan Karaarslan
Format: Article
Language:English
Published: Nature Publishing Group 2021-06-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-021-91467-x
id doaj-897683b2837b4094b80466289ed7a30d
record_format Article
spelling doaj-897683b2837b4094b80466289ed7a30d2021-06-20T11:34:56ZengNature Publishing GroupScientific Reports2045-23222021-06-0111111010.1038/s41598-021-91467-xInter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter studyDeniz Alis0Mert Yergin1Ceren Alis2Cagdas Topel3Ozan Asmakutlu4Omer Bagcilar5Yeseren Deniz Senli6Ahmet Ustundag7Vefa Salt8Sebahat Nacar Dogan9Murat Velioglu10Hakan Hatem Selcuk11Batuhan Kara12Ilkay Oksuz13Osman Kizilkilic14Ercan Karaarslan15Department of Radiology, Acibadem Mehmet Ali Aydinlar University School of MedicineDepartment of Software Engineering and Applied Sciences, Bahcesehir UniversityCerrahpaşa Medical Faculty, Neurology Department, Istanbul University-CerrahpasaDepartment of Radiology, Istanbul Mehmet Akif Ersoy Thoracic and Cardiovascular Surgery Training and Research HospitalDepartment of Radiology, Istanbul Mehmet Akif Ersoy Thoracic and Cardiovascular Surgery Training and Research HospitalRadiology Department, Istanbul Silivri State HospitalCerrahpaşa Medical Faculty, Radiology Department, Istanbul University-CerrahpasaCerrahpaşa Medical Faculty, Radiology Department, Istanbul University-CerrahpasaCerrahpaşa Medical Faculty, Radiology Department, Istanbul University-CerrahpasaRadiology Department, Istanbul Gaziosmanpasa Training and Research HospitalRadiology Department, Istanbul Fatih Sultan Mehmet Training and Research HospitalRadiology Department, Istanbul Bakırköy Sadi Konuk Training and Research HospitalRadiology Department, Istanbul Bakırköy Sadi Konuk Training and Research HospitalDepartment of Software Engineering and Applied Sciences, Istanbul Technical UniversityCerrahpaşa Medical Faculty, Radiology Department, Istanbul University-CerrahpasaDepartment of Radiology, Acibadem Mehmet Ali Aydinlar University School of MedicineAbstract There is little evidence on the applicability of deep learning (DL) in the segmentation of acute ischemic lesions on diffusion-weighted imaging (DWI) between magnetic resonance imaging (MRI) scanners of different manufacturers. We retrospectively included DWI data of patients with acute ischemic lesions from six centers. Dataset A (n = 2986) and B (n = 3951) included data from Siemens and GE MRI scanners, respectively. The datasets were split into the training (80%), validation (10%), and internal test (10%) sets, and six neuroradiologists created ground-truth masks. Models A and B were the proposed neural networks trained on datasets A and B. The models subsequently fine-tuned across the datasets using their validation data. Another radiologist performed the segmentation on the test sets for comparisons. The median Dice scores of models A and B were 0.858 and 0.857 for the internal tests, which were non-inferior to the radiologist’s performance, but demonstrated lower performance than the radiologist on the external tests. Fine-tuned models A and B achieved median Dice scores of 0.832 and 0.846, which were non-inferior to the radiologist's performance on the external tests. The present work shows that the inter-vendor operability of deep learning for the segmentation of ischemic lesions on DWI might be enhanced via transfer learning; thereby, their clinical applicability and generalizability could be improved.https://doi.org/10.1038/s41598-021-91467-x
collection DOAJ
language English
format Article
sources DOAJ
author Deniz Alis
Mert Yergin
Ceren Alis
Cagdas Topel
Ozan Asmakutlu
Omer Bagcilar
Yeseren Deniz Senli
Ahmet Ustundag
Vefa Salt
Sebahat Nacar Dogan
Murat Velioglu
Hakan Hatem Selcuk
Batuhan Kara
Ilkay Oksuz
Osman Kizilkilic
Ercan Karaarslan
spellingShingle Deniz Alis
Mert Yergin
Ceren Alis
Cagdas Topel
Ozan Asmakutlu
Omer Bagcilar
Yeseren Deniz Senli
Ahmet Ustundag
Vefa Salt
Sebahat Nacar Dogan
Murat Velioglu
Hakan Hatem Selcuk
Batuhan Kara
Ilkay Oksuz
Osman Kizilkilic
Ercan Karaarslan
Inter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter study
Scientific Reports
author_facet Deniz Alis
Mert Yergin
Ceren Alis
Cagdas Topel
Ozan Asmakutlu
Omer Bagcilar
Yeseren Deniz Senli
Ahmet Ustundag
Vefa Salt
Sebahat Nacar Dogan
Murat Velioglu
Hakan Hatem Selcuk
Batuhan Kara
Ilkay Oksuz
Osman Kizilkilic
Ercan Karaarslan
author_sort Deniz Alis
title Inter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter study
title_short Inter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter study
title_full Inter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter study
title_fullStr Inter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter study
title_full_unstemmed Inter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter study
title_sort inter-vendor performance of deep learning in segmenting acute ischemic lesions on diffusion-weighted imaging: a multicenter study
publisher Nature Publishing Group
series Scientific Reports
issn 2045-2322
publishDate 2021-06-01
description Abstract There is little evidence on the applicability of deep learning (DL) in the segmentation of acute ischemic lesions on diffusion-weighted imaging (DWI) between magnetic resonance imaging (MRI) scanners of different manufacturers. We retrospectively included DWI data of patients with acute ischemic lesions from six centers. Dataset A (n = 2986) and B (n = 3951) included data from Siemens and GE MRI scanners, respectively. The datasets were split into the training (80%), validation (10%), and internal test (10%) sets, and six neuroradiologists created ground-truth masks. Models A and B were the proposed neural networks trained on datasets A and B. The models subsequently fine-tuned across the datasets using their validation data. Another radiologist performed the segmentation on the test sets for comparisons. The median Dice scores of models A and B were 0.858 and 0.857 for the internal tests, which were non-inferior to the radiologist’s performance, but demonstrated lower performance than the radiologist on the external tests. Fine-tuned models A and B achieved median Dice scores of 0.832 and 0.846, which were non-inferior to the radiologist's performance on the external tests. The present work shows that the inter-vendor operability of deep learning for the segmentation of ischemic lesions on DWI might be enhanced via transfer learning; thereby, their clinical applicability and generalizability could be improved.
url https://doi.org/10.1038/s41598-021-91467-x
work_keys_str_mv AT denizalis intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT mertyergin intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT cerenalis intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT cagdastopel intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT ozanasmakutlu intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT omerbagcilar intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT yeserendenizsenli intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT ahmetustundag intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT vefasalt intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT sebahatnacardogan intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT muratvelioglu intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT hakanhatemselcuk intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT batuhankara intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT ilkayoksuz intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT osmankizilkilic intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
AT ercankaraarslan intervendorperformanceofdeeplearninginsegmentingacuteischemiclesionsondiffusionweightedimagingamulticenterstudy
_version_ 1721369886150623232