A 2D–3D hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapy

Abstract Background Accurate segmentation of lung lobe on routine computed tomography (CT) images of locally advanced stage lung cancer patients undergoing radiotherapy can help radiation oncologists to implement lobar-level treatment planning, dose assessment and efficacy prediction. We aim to esta...

Full description

Bibliographic Details
Main Authors: Hengle Gu, Wutian Gan, Chenchen Zhang, Aihui Feng, Hao Wang, Ying Huang, Hua Chen, Yan Shao, Yanhua Duan, Zhiyong Xu
Format: Article
Language:English
Published: BMC 2021-09-01
Series:BioMedical Engineering OnLine
Subjects:
Online Access:https://doi.org/10.1186/s12938-021-00932-1
id doaj-9e484d4e7a974feda2b8eab7aeb36521
record_format Article
spelling doaj-9e484d4e7a974feda2b8eab7aeb365212021-09-26T11:18:22ZengBMCBioMedical Engineering OnLine1475-925X2021-09-0120111310.1186/s12938-021-00932-1A 2D–3D hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapyHengle Gu0Wutian Gan1Chenchen Zhang2Aihui Feng3Hao Wang4Ying Huang5Hua Chen6Yan Shao7Yanhua Duan8Zhiyong Xu9Shanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityShanghai Chest Hospital, Shanghai Jiao Tong UniversityAbstract Background Accurate segmentation of lung lobe on routine computed tomography (CT) images of locally advanced stage lung cancer patients undergoing radiotherapy can help radiation oncologists to implement lobar-level treatment planning, dose assessment and efficacy prediction. We aim to establish a novel 2D–3D hybrid convolutional neural network (CNN) to provide reliable lung lobe auto-segmentation results in the clinical setting. Methods We retrospectively collected and evaluated thorax CT scans of 105 locally advanced non-small-cell lung cancer (NSCLC) patients treated at our institution from June 2019 to August 2020. The CT images were acquired with 5 mm slice thickness. Two CNNs were used for lung lobe segmentation, a 3D CNN for extracting 3D contextual information and a 2D CNN for extracting texture information. Contouring quality was evaluated using six quantitative metrics and visual evaluation was performed to assess the clinical acceptability. Results For the 35 cases in the test group, Dice Similarity Coefficient (DSC) of all lung lobes contours exceeded 0.75, which met the pass criteria of the segmentation result. Our model achieved high performances with DSC as high as 0.9579, 0.9479, 0.9507, 0.9484, and 0.9003 for left upper lobe (LUL), left lower lobe (LLL), right upper lobe (RUL), right lower lobe (RLL), and right middle lobe (RML), respectively. The proposed model resulted in accuracy, sensitivity, and specificity of 99.57, 98.23, 99.65 for LUL; 99.6, 96.14, 99.76 for LLL; 99.67, 96.13, 99.81 for RUL; 99.72, 92.38, 99.83 for RML; 99.58, 96.03, 99.78 for RLL, respectively. Clinician's visual assessment showed that 164/175 lobe contours met the requirements for clinical use, only 11 contours need manual correction. Conclusions Our 2D–3D hybrid CNN model achieved accurate automatic segmentation of lung lobes on conventional slice-thickness CT of locally advanced lung cancer patients, and has good clinical practicability.https://doi.org/10.1186/s12938-021-00932-1Artificial intelligenceComputed tomographyAutomatic segmentationLung lobeConvolutional neural network
collection DOAJ
language English
format Article
sources DOAJ
author Hengle Gu
Wutian Gan
Chenchen Zhang
Aihui Feng
Hao Wang
Ying Huang
Hua Chen
Yan Shao
Yanhua Duan
Zhiyong Xu
spellingShingle Hengle Gu
Wutian Gan
Chenchen Zhang
Aihui Feng
Hao Wang
Ying Huang
Hua Chen
Yan Shao
Yanhua Duan
Zhiyong Xu
A 2D–3D hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapy
BioMedical Engineering OnLine
Artificial intelligence
Computed tomography
Automatic segmentation
Lung lobe
Convolutional neural network
author_facet Hengle Gu
Wutian Gan
Chenchen Zhang
Aihui Feng
Hao Wang
Ying Huang
Hua Chen
Yan Shao
Yanhua Duan
Zhiyong Xu
author_sort Hengle Gu
title A 2D–3D hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapy
title_short A 2D–3D hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapy
title_full A 2D–3D hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapy
title_fullStr A 2D–3D hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapy
title_full_unstemmed A 2D–3D hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapy
title_sort 2d–3d hybrid convolutional neural network for lung lobe auto-segmentation on standard slice thickness computed tomography of patients receiving radiotherapy
publisher BMC
series BioMedical Engineering OnLine
issn 1475-925X
publishDate 2021-09-01
description Abstract Background Accurate segmentation of lung lobe on routine computed tomography (CT) images of locally advanced stage lung cancer patients undergoing radiotherapy can help radiation oncologists to implement lobar-level treatment planning, dose assessment and efficacy prediction. We aim to establish a novel 2D–3D hybrid convolutional neural network (CNN) to provide reliable lung lobe auto-segmentation results in the clinical setting. Methods We retrospectively collected and evaluated thorax CT scans of 105 locally advanced non-small-cell lung cancer (NSCLC) patients treated at our institution from June 2019 to August 2020. The CT images were acquired with 5 mm slice thickness. Two CNNs were used for lung lobe segmentation, a 3D CNN for extracting 3D contextual information and a 2D CNN for extracting texture information. Contouring quality was evaluated using six quantitative metrics and visual evaluation was performed to assess the clinical acceptability. Results For the 35 cases in the test group, Dice Similarity Coefficient (DSC) of all lung lobes contours exceeded 0.75, which met the pass criteria of the segmentation result. Our model achieved high performances with DSC as high as 0.9579, 0.9479, 0.9507, 0.9484, and 0.9003 for left upper lobe (LUL), left lower lobe (LLL), right upper lobe (RUL), right lower lobe (RLL), and right middle lobe (RML), respectively. The proposed model resulted in accuracy, sensitivity, and specificity of 99.57, 98.23, 99.65 for LUL; 99.6, 96.14, 99.76 for LLL; 99.67, 96.13, 99.81 for RUL; 99.72, 92.38, 99.83 for RML; 99.58, 96.03, 99.78 for RLL, respectively. Clinician's visual assessment showed that 164/175 lobe contours met the requirements for clinical use, only 11 contours need manual correction. Conclusions Our 2D–3D hybrid CNN model achieved accurate automatic segmentation of lung lobes on conventional slice-thickness CT of locally advanced lung cancer patients, and has good clinical practicability.
topic Artificial intelligence
Computed tomography
Automatic segmentation
Lung lobe
Convolutional neural network
url https://doi.org/10.1186/s12938-021-00932-1
work_keys_str_mv AT henglegu a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT wutiangan a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT chenchenzhang a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT aihuifeng a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT haowang a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT yinghuang a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT huachen a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT yanshao a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT yanhuaduan a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT zhiyongxu a2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT henglegu 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT wutiangan 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT chenchenzhang 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT aihuifeng 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT haowang 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT yinghuang 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT huachen 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT yanshao 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT yanhuaduan 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
AT zhiyongxu 2d3dhybridconvolutionalneuralnetworkforlunglobeautosegmentationonstandardslicethicknesscomputedtomographyofpatientsreceivingradiotherapy
_version_ 1716868106605821952