Deep Learning for Classification of Bone Lesions on Routine MRI

Background: Radiologists have difficulty distinguishing benign from malignant bone lesions because these lesions may have similar imaging appearances. The purpose of this study was to develop a deep learning algorithm that can differentiate benign and malignant bone lesions using routine magnetic re...

Full description

Bibliographic Details
Main Authors: Feyisope R. Eweje, SB, Bingting Bao, MS, Jing Wu, MD, Deepa Dalal, MBBS, Wei-hua Liao, MD, Yu He, MD, Yongheng Luo, MD, Shaolei Lu, MD, PhD, Paul Zhang, MD, Xianjing Peng, MD, Ronnie Sebro, MD, PhD, Harrison X. Bai, MD, Lisa States, MD
Format: Article
Language:English
Published: Elsevier 2021-06-01
Series:EBioMedicine
Subjects:
MRI
Online Access:http://www.sciencedirect.com/science/article/pii/S235239642100195X
id doaj-04441b2840f14928bd15d6310600752a
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Feyisope R. Eweje, SB
Bingting Bao, MS
Jing Wu, MD
Deepa Dalal, MBBS
Wei-hua Liao, MD
Yu He, MD
Yongheng Luo, MD
Shaolei Lu, MD, PhD
Paul Zhang, MD
Xianjing Peng, MD
Ronnie Sebro, MD, PhD
Harrison X. Bai, MD
Lisa States, MD
spellingShingle Feyisope R. Eweje, SB
Bingting Bao, MS
Jing Wu, MD
Deepa Dalal, MBBS
Wei-hua Liao, MD
Yu He, MD
Yongheng Luo, MD
Shaolei Lu, MD, PhD
Paul Zhang, MD
Xianjing Peng, MD
Ronnie Sebro, MD, PhD
Harrison X. Bai, MD
Lisa States, MD
Deep Learning for Classification of Bone Lesions on Routine MRI
EBioMedicine
Deep learning
MRI
Bone tumor
Convolutional neural network
Bone lesion
author_facet Feyisope R. Eweje, SB
Bingting Bao, MS
Jing Wu, MD
Deepa Dalal, MBBS
Wei-hua Liao, MD
Yu He, MD
Yongheng Luo, MD
Shaolei Lu, MD, PhD
Paul Zhang, MD
Xianjing Peng, MD
Ronnie Sebro, MD, PhD
Harrison X. Bai, MD
Lisa States, MD
author_sort Feyisope R. Eweje, SB
title Deep Learning for Classification of Bone Lesions on Routine MRI
title_short Deep Learning for Classification of Bone Lesions on Routine MRI
title_full Deep Learning for Classification of Bone Lesions on Routine MRI
title_fullStr Deep Learning for Classification of Bone Lesions on Routine MRI
title_full_unstemmed Deep Learning for Classification of Bone Lesions on Routine MRI
title_sort deep learning for classification of bone lesions on routine mri
publisher Elsevier
series EBioMedicine
issn 2352-3964
publishDate 2021-06-01
description Background: Radiologists have difficulty distinguishing benign from malignant bone lesions because these lesions may have similar imaging appearances. The purpose of this study was to develop a deep learning algorithm that can differentiate benign and malignant bone lesions using routine magnetic resonance imaging (MRI) and patient demographics. Methods: 1,060 histologically confirmed bone lesions with T1- and T2-weighted pre-operative MRI were retrospectively identified and included, with lesions from 4 institutions used for model development and internal validation, and data from a fifth institution used for external validation. Image-based models were generated using the EfficientNet-B0 architecture and a logistic regression model was trained using patient age, sex, and lesion location. A voting ensemble was created as the final model. The performance of the model was compared to classification performance by radiology experts. Findings: The cohort had a mean age of 30±23 years and was 58.3% male, with 582 benign lesions and 478 malignant. Compared to a contrived expert committee result, the ensemble deep learning model achieved (ensemble vs. experts): similar accuracy (0·76 vs. 0·73, p=0·7), sensitivity (0·79 vs. 0·81, p=1·0) and specificity (0·75 vs. 0·66, p=0·48), with a ROC AUC of 0·82. On external testing, the model achieved ROC AUC of 0·79. Interpretation: Deep learning can be used to distinguish benign and malignant bone lesions on par with experts. These findings could aid in the development of computer-aided diagnostic tools to reduce unnecessary referrals to specialized centers from community clinics and limit unnecessary biopsies. Funding: This work was funded by a Radiological Society of North America Research Medical Student Grant (#RMS2013) and supported by the Amazon Web Services Diagnostic Development Initiative.
topic Deep learning
MRI
Bone tumor
Convolutional neural network
Bone lesion
url http://www.sciencedirect.com/science/article/pii/S235239642100195X
work_keys_str_mv AT feyisoperewejesb deeplearningforclassificationofbonelesionsonroutinemri
AT bingtingbaoms deeplearningforclassificationofbonelesionsonroutinemri
AT jingwumd deeplearningforclassificationofbonelesionsonroutinemri
AT deepadalalmbbs deeplearningforclassificationofbonelesionsonroutinemri
AT weihualiaomd deeplearningforclassificationofbonelesionsonroutinemri
AT yuhemd deeplearningforclassificationofbonelesionsonroutinemri
AT yonghengluomd deeplearningforclassificationofbonelesionsonroutinemri
AT shaoleilumdphd deeplearningforclassificationofbonelesionsonroutinemri
AT paulzhangmd deeplearningforclassificationofbonelesionsonroutinemri
AT xianjingpengmd deeplearningforclassificationofbonelesionsonroutinemri
AT ronniesebromdphd deeplearningforclassificationofbonelesionsonroutinemri
AT harrisonxbaimd deeplearningforclassificationofbonelesionsonroutinemri
AT lisastatesmd deeplearningforclassificationofbonelesionsonroutinemri
_version_ 1721360574535696384
spelling doaj-04441b2840f14928bd15d6310600752a2021-06-25T04:48:58ZengElsevierEBioMedicine2352-39642021-06-0168103402Deep Learning for Classification of Bone Lesions on Routine MRIFeyisope R. Eweje, SB0Bingting Bao, MS1Jing Wu, MD2Deepa Dalal, MBBS3Wei-hua Liao, MD4Yu He, MD5Yongheng Luo, MD6Shaolei Lu, MD, PhD7Paul Zhang, MD8Xianjing Peng, MD9Ronnie Sebro, MD, PhD10Harrison X. Bai, MD11Lisa States, MD12Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA; Perelman School of Medicine at University of Pennsylvania, Philadelphia, PA, 19104, USADepartment of Radiology, Second Xiangya Hospital of Central South University, Changsha, Hunan, 410011, ChinaDepartment of Radiology, Second Xiangya Hospital of Central South University, Changsha, Hunan, 410011, ChinaDepartment of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USADepartment of Radiology, Xiangya Hospital of Central South University, Changsha, Hunan, 410008, ChinaDepartment of Radiology, Second Xiangya Hospital of Central South University, Changsha, Hunan, 410011, ChinaDepartment of Radiology, Second Xiangya Hospital of Central South University, Changsha, Hunan, 410011, ChinaDepartment of Pathology and Laboratory Medicine, Warren Alpert Medical School of Brown University, Providence, RI, 02903, USADepartment of Pathology and Laboratory Medicine, Hospital of the University of Pennsylvania, Philadelphia, PA, 19104, USADepartment of Radiology, Xiangya Hospital of Central South University, Changsha, Hunan, 410008, China; Xianjing Peng, Department of Radiology, Xiangya Hospital of Central South University, Changsha, Hunan, 410008, China.Mayo Clinic Radiology, Jacksonville, FL, 32224, USADepartment of Diagnostic Imaging, Rhode Island Hospital, Providence, RI, 02903, USA; Harrison X. Bai, Department of Diagnostic Imaging, Warren Alpert Medical School of Brown University, Providence, Rhode Island 02912, USA. Phone: (401)793- 4480; Fax: (401)793-4444.Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA; Corresponding authors: Lisa States, Department of Radiology, Children's Hospital of Philadelphia, Philadelphia, PA, 19104, USA. Phone: (267)425-7146; Fax: (267)425-7068.Background: Radiologists have difficulty distinguishing benign from malignant bone lesions because these lesions may have similar imaging appearances. The purpose of this study was to develop a deep learning algorithm that can differentiate benign and malignant bone lesions using routine magnetic resonance imaging (MRI) and patient demographics. Methods: 1,060 histologically confirmed bone lesions with T1- and T2-weighted pre-operative MRI were retrospectively identified and included, with lesions from 4 institutions used for model development and internal validation, and data from a fifth institution used for external validation. Image-based models were generated using the EfficientNet-B0 architecture and a logistic regression model was trained using patient age, sex, and lesion location. A voting ensemble was created as the final model. The performance of the model was compared to classification performance by radiology experts. Findings: The cohort had a mean age of 30±23 years and was 58.3% male, with 582 benign lesions and 478 malignant. Compared to a contrived expert committee result, the ensemble deep learning model achieved (ensemble vs. experts): similar accuracy (0·76 vs. 0·73, p=0·7), sensitivity (0·79 vs. 0·81, p=1·0) and specificity (0·75 vs. 0·66, p=0·48), with a ROC AUC of 0·82. On external testing, the model achieved ROC AUC of 0·79. Interpretation: Deep learning can be used to distinguish benign and malignant bone lesions on par with experts. These findings could aid in the development of computer-aided diagnostic tools to reduce unnecessary referrals to specialized centers from community clinics and limit unnecessary biopsies. Funding: This work was funded by a Radiological Society of North America Research Medical Student Grant (#RMS2013) and supported by the Amazon Web Services Diagnostic Development Initiative.http://www.sciencedirect.com/science/article/pii/S235239642100195XDeep learningMRIBone tumorConvolutional neural networkBone lesion