Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy
Abstract The manual reading of capsule endoscopy (CE) videos in small bowel disease diagnosis is time-intensive. Algorithms introduced to automate this process are premature for real clinical applications, and multi-diagnosis using these methods has not been sufficiently validated. Therefore, we dev...
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Nature Publishing Group
2021-09-01
|
Series: | Scientific Reports |
Online Access: | https://doi.org/10.1038/s41598-021-96748-z |
id |
doaj-c7ec7dda26254e068eb086a14b675a25 |
---|---|
record_format |
Article |
spelling |
doaj-c7ec7dda26254e068eb086a14b675a252021-09-05T11:31:03ZengNature Publishing GroupScientific Reports2045-23222021-09-0111111110.1038/s41598-021-96748-zEfficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopySang Hoon Kim0Youngbae Hwang1Dong Jun Oh2Ji Hyung Nam3Ki Bae Kim4Junseok Park5Hyun Joo Song6Yun Jeong Lim7Department of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of MedicineDepartment of Electronics Engineering, College of Electrical and Computer Engineering, Chungbuk National UniversityDepartment of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of MedicineDepartment of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of MedicineDepartment of Internal Medicine, Chungbuk National University College of MedicineDepartment of Internal Medicine, Digestive Disease Center, Institute for Digestive Research, Soonchunhyang University College of MedicineDepartment of Internal Medicine, Jeju National University School of MedicineDepartment of Internal Medicine, Dongguk University Ilsan Hospital, Dongguk University College of MedicineAbstract The manual reading of capsule endoscopy (CE) videos in small bowel disease diagnosis is time-intensive. Algorithms introduced to automate this process are premature for real clinical applications, and multi-diagnosis using these methods has not been sufficiently validated. Therefore, we developed a practical binary classification model, which selectively identifies clinically meaningful images including inflamed mucosa, atypical vascularity or bleeding, and tested it with unseen cases. Four hundred thousand CE images were randomly selected from 84 cases in which 240,000 images were used to train the algorithm to categorize images binarily. The remaining images were utilized for validation and internal testing. The algorithm was externally tested with 256,591 unseen images. The diagnostic accuracy of the trained model applied to the validation set was 98.067%. In contrast, the accuracy of the model when applied to a dataset provided by an independent hospital that did not participate during training was 85.470%. The area under the curve (AUC) was 0.922. Our model showed excellent internal test results, and the misreadings were slightly increased when the model was tested in unseen external cases while the classified ‘insignificant’ images contain ambiguous substances. Once this limitation is solved, the proposed CNN-based binary classification will be a promising candidate for developing clinically-ready computer-aided reading methods.https://doi.org/10.1038/s41598-021-96748-z |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Sang Hoon Kim Youngbae Hwang Dong Jun Oh Ji Hyung Nam Ki Bae Kim Junseok Park Hyun Joo Song Yun Jeong Lim |
spellingShingle |
Sang Hoon Kim Youngbae Hwang Dong Jun Oh Ji Hyung Nam Ki Bae Kim Junseok Park Hyun Joo Song Yun Jeong Lim Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy Scientific Reports |
author_facet |
Sang Hoon Kim Youngbae Hwang Dong Jun Oh Ji Hyung Nam Ki Bae Kim Junseok Park Hyun Joo Song Yun Jeong Lim |
author_sort |
Sang Hoon Kim |
title |
Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy |
title_short |
Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy |
title_full |
Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy |
title_fullStr |
Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy |
title_full_unstemmed |
Efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy |
title_sort |
efficacy of a comprehensive binary classification model using a deep convolutional neural network for wireless capsule endoscopy |
publisher |
Nature Publishing Group |
series |
Scientific Reports |
issn |
2045-2322 |
publishDate |
2021-09-01 |
description |
Abstract The manual reading of capsule endoscopy (CE) videos in small bowel disease diagnosis is time-intensive. Algorithms introduced to automate this process are premature for real clinical applications, and multi-diagnosis using these methods has not been sufficiently validated. Therefore, we developed a practical binary classification model, which selectively identifies clinically meaningful images including inflamed mucosa, atypical vascularity or bleeding, and tested it with unseen cases. Four hundred thousand CE images were randomly selected from 84 cases in which 240,000 images were used to train the algorithm to categorize images binarily. The remaining images were utilized for validation and internal testing. The algorithm was externally tested with 256,591 unseen images. The diagnostic accuracy of the trained model applied to the validation set was 98.067%. In contrast, the accuracy of the model when applied to a dataset provided by an independent hospital that did not participate during training was 85.470%. The area under the curve (AUC) was 0.922. Our model showed excellent internal test results, and the misreadings were slightly increased when the model was tested in unseen external cases while the classified ‘insignificant’ images contain ambiguous substances. Once this limitation is solved, the proposed CNN-based binary classification will be a promising candidate for developing clinically-ready computer-aided reading methods. |
url |
https://doi.org/10.1038/s41598-021-96748-z |
work_keys_str_mv |
AT sanghoonkim efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy AT youngbaehwang efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy AT dongjunoh efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy AT jihyungnam efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy AT kibaekim efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy AT junseokpark efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy AT hyunjoosong efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy AT yunjeonglim efficacyofacomprehensivebinaryclassificationmodelusingadeepconvolutionalneuralnetworkforwirelesscapsuleendoscopy |
_version_ |
1717814186338156544 |