Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy

Abstract The manual reading of capsule endoscopy (CE) videos in small bowel disease diagnosis is time-intensive. Algorithms introduced to automate this process are premature for real clinical applications, and multi-diagnosis using these methods has not been sufficiently validated. Therefore, we dev...

Full description

Bibliographic Details
Main Authors: Sang Hoon Kim, Youngbae Hwang, Dong Jun Oh, Ji Hyung Nam, Ki Bae Kim, Junseok Park, Hyun Joo Song, Yun Jeong Lim
Format: Article
Language:English
Published: Nature Publishing Group 2021-09-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-021-96748-z
id doaj-c7ec7dda26254e068eb086a14b675a25
record_format Article
spelling doaj-c7ec7dda26254e068eb086a14b675a252021-09-05T11:31:03ZengNature Publishing GroupScientific Reports2045-23222021-09-0111111110.1038/s41598-021-96748-zEfficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopySang Hoon Kim0Youngbae Hwang1Dong Jun Oh2Ji Hyung Nam3Ki Bae Kim4Junseok Park5Hyun Joo Song6Yun Jeong Lim7Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of MedicineDepartment of Electronics Engineering, College of Electrical and Computer Engineering, Chungbuk National UniversityDepartment of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of MedicineDepartment of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of MedicineDepartment of Internal Medicine, Chungbuk National University College of MedicineDepartment of Internal Medicine, Digestive Disease Center, Institute for Digestive Research, Soonchunhyang University College of MedicineDepartment of Internal Medicine, Jeju National University School of MedicineDepartment of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of MedicineAbstract The manual reading of capsule endoscopy (CE) videos in small bowel disease diagnosis is time-intensive. Algorithms introduced to automate this process are premature for real clinical applications, and multi-diagnosis using these methods has not been sufficiently validated. Therefore, we developed a practical binary classification model, which selectively identifies clinically meaningful images including inflamed mucosa, atypical vascularity or bleeding, and tested it with unseen cases. Four hundred thousand CE images were randomly selected from 84 cases in which 240,000 images were used to train the algorithm to categorize images binarily. The remaining images were utilized for validation and internal testing. The algorithm was externally tested with 256,591 unseen images. The diagnostic accuracy of the trained model applied to the validation set was 98.067%. In contrast, the accuracy of the model when applied to a dataset provided by an independent hospital that did not participate during training was 85.470%. The area under the curve (AUC) was 0.922. Our model showed excellent internal test results, and the misreadings were slightly increased when the model was tested in unseen external cases while the classified ‘insignificant’ images contain ambiguous substances. Once this limitation is solved, the proposed CNN-based binary classification will be a promising candidate for developing clinically-ready computer-aided reading methods.https://doi.org/10.1038/s41598-021-96748-z
collection DOAJ
language English
format Article
sources DOAJ
author Sang Hoon Kim
Youngbae Hwang
Dong Jun Oh
Ji Hyung Nam
Ki Bae Kim
Junseok Park
Hyun Joo Song
Yun Jeong Lim
spellingShingle Sang Hoon Kim
Youngbae Hwang
Dong Jun Oh
Ji Hyung Nam
Ki Bae Kim
Junseok Park
Hyun Joo Song
Yun Jeong Lim
Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy
Scientific Reports
author_facet Sang Hoon Kim
Youngbae Hwang
Dong Jun Oh
Ji Hyung Nam
Ki Bae Kim
Junseok Park
Hyun Joo Song
Yun Jeong Lim
author_sort Sang Hoon Kim
title Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy
title_short Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy
title_full Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy
title_fullStr Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy
title_full_unstemmed Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy
title_sort efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy
publisher Nature Publishing Group
series Scientific Reports
issn 2045-2322
publishDate 2021-09-01
description Abstract The manual reading of capsule endoscopy (CE) videos in small bowel disease diagnosis is time-intensive. Algorithms introduced to automate this process are premature for real clinical applications, and multi-diagnosis using these methods has not been sufficiently validated. Therefore, we developed a practical binary classification model, which selectively identifies clinically meaningful images including inflamed mucosa, atypical vascularity or bleeding, and tested it with unseen cases. Four hundred thousand CE images were randomly selected from 84 cases in which 240,000 images were used to train the algorithm to categorize images binarily. The remaining images were utilized for validation and internal testing. The algorithm was externally tested with 256,591 unseen images. The diagnostic accuracy of the trained model applied to the validation set was 98.067%. In contrast, the accuracy of the model when applied to a dataset provided by an independent hospital that did not participate during training was 85.470%. The area under the curve (AUC) was 0.922. Our model showed excellent internal test results, and the misreadings were slightly increased when the model was tested in unseen external cases while the classified ‘insignificant’ images contain ambiguous substances. Once this limitation is solved, the proposed CNN-based binary classification will be a promising candidate for developing clinically-ready computer-aided reading methods.
url https://doi.org/10.1038/s41598-021-96748-z
work_keys_str_mv AT sanghoonkim efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy
AT youngbaehwang efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy
AT dongjunoh efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy
AT jihyungnam efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy
AT kibaekim efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy
AT junseokpark efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy
AT hyunjoosong efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy
AT yunjeonglim efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy
_version_ 1717814186338156544