Automated Classification of Blood Loss from Transurethral Resection of the Prostate Surgery Videos Using Deep Learning Technique
Transurethral resection of the prostate (TURP) is a surgical removal of obstructing prostate tissue. The total bleeding area is used to determine the performance of the TURP surgery. Although the traditional method for the detection of bleeding areas provides accurate results, it cannot detect them...
Main Authors: | , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2020-07-01
|
Series: | Applied Sciences |
Subjects: | |
Online Access: | https://www.mdpi.com/2076-3417/10/14/4908 |
id |
doaj-a3995dc2a1c34a9d9b2ac91539710829 |
---|---|
record_format |
Article |
spelling |
doaj-a3995dc2a1c34a9d9b2ac915397108292020-11-25T03:31:12ZengMDPI AGApplied Sciences2076-34172020-07-01104908490810.3390/app10144908Automated Classification of Blood Loss from Transurethral Resection of the Prostate Surgery Videos Using Deep Learning TechniqueJian-Wen Chen0Wan-Ju Lin1Chun-Yuan Lin2Che-Lun Hung3Chen-Pang Hou4Ching-Che Cho5Hong-Tsu Young6Chuan-Yi Tang7Institute of Biomedical Informatics, National Yang-Ming University, Taipei 11221, TaiwanAI Innovation Research Center, Chang Gung University, Taoyuan 33302, TaiwanAI Innovation Research Center, Chang Gung University, Taoyuan 33302, TaiwanInstitute of Biomedical Informatics, National Yang-Ming University, Taipei 11221, TaiwanDepartment of Urology, Chang Gung Memorial Hospital at linkou, Taoyuan 33302, TaiwanDepartment of Urology, Chang Gung Memorial Hospital at linkou, Taoyuan 33302, TaiwanDepartment of Mechanical Engineering, National Taiwan University, Taipei 10617, TaiwanDepartment of Computer Science and Information Engineering, Providence University, Taichung 43301, TaiwanTransurethral resection of the prostate (TURP) is a surgical removal of obstructing prostate tissue. The total bleeding area is used to determine the performance of the TURP surgery. Although the traditional method for the detection of bleeding areas provides accurate results, it cannot detect them in time for surgery diagnosis. Moreover, it is easily disturbed to judge bleeding areas for experienced physicians because a red light pattern arising from the surgical cutting loop often appears on the images. Recently, the automatic computer-aided technique and artificial intelligence deep learning are broadly used in medical image recognition, which can effectively extract the desired features to reduce the burden of physicians and increase the accuracy of diagnosis. In this study, we integrated two state-of-the-art deep learning techniques for recognizing and extracting the red light areas arising from the cutting loop in the TURP surgery. First, the ResNet-50 model was used to recognize the red light pattern appearing in the chipped frames of the surgery videos. Then, the proposed Res-Unet model was used to segment the areas with the red light pattern and remove these areas. Finally, the hue, saturation, and value color space were used to classify the four levels of the blood loss under the circumstances of non-red light pattern images. The experiments have shown that the proposed Res-Unet model achieves higher accuracy than other segmentation algorithms in classifying the images with the red and non-red lights, and is able to extract the red light patterns and effectively remove them in the TURP surgery images. The proposed approaches presented here are capable of obtaining the level classifications of blood loss, which are helpful for physicians in diagnosis.https://www.mdpi.com/2076-3417/10/14/4908U-Net modelResNet-50 modelHSV color spacetransurethral resection of the prostate (TURP)classification of bleeding areablood loss |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Jian-Wen Chen Wan-Ju Lin Chun-Yuan Lin Che-Lun Hung Chen-Pang Hou Ching-Che Cho Hong-Tsu Young Chuan-Yi Tang |
spellingShingle |
Jian-Wen Chen Wan-Ju Lin Chun-Yuan Lin Che-Lun Hung Chen-Pang Hou Ching-Che Cho Hong-Tsu Young Chuan-Yi Tang Automated Classification of Blood Loss from Transurethral Resection of the Prostate Surgery Videos Using Deep Learning Technique Applied Sciences U-Net model ResNet-50 model HSV color space transurethral resection of the prostate (TURP) classification of bleeding area blood loss |
author_facet |
Jian-Wen Chen Wan-Ju Lin Chun-Yuan Lin Che-Lun Hung Chen-Pang Hou Ching-Che Cho Hong-Tsu Young Chuan-Yi Tang |
author_sort |
Jian-Wen Chen |
title |
Automated Classification of Blood Loss from Transurethral Resection of the Prostate Surgery Videos Using Deep Learning Technique |
title_short |
Automated Classification of Blood Loss from Transurethral Resection of the Prostate Surgery Videos Using Deep Learning Technique |
title_full |
Automated Classification of Blood Loss from Transurethral Resection of the Prostate Surgery Videos Using Deep Learning Technique |
title_fullStr |
Automated Classification of Blood Loss from Transurethral Resection of the Prostate Surgery Videos Using Deep Learning Technique |
title_full_unstemmed |
Automated Classification of Blood Loss from Transurethral Resection of the Prostate Surgery Videos Using Deep Learning Technique |
title_sort |
automated classification of blood loss from transurethral resection of the prostate surgery videos using deep learning technique |
publisher |
MDPI AG |
series |
Applied Sciences |
issn |
2076-3417 |
publishDate |
2020-07-01 |
description |
Transurethral resection of the prostate (TURP) is a surgical removal of obstructing prostate tissue. The total bleeding area is used to determine the performance of the TURP surgery. Although the traditional method for the detection of bleeding areas provides accurate results, it cannot detect them in time for surgery diagnosis. Moreover, it is easily disturbed to judge bleeding areas for experienced physicians because a red light pattern arising from the surgical cutting loop often appears on the images. Recently, the automatic computer-aided technique and artificial intelligence deep learning are broadly used in medical image recognition, which can effectively extract the desired features to reduce the burden of physicians and increase the accuracy of diagnosis. In this study, we integrated two state-of-the-art deep learning techniques for recognizing and extracting the red light areas arising from the cutting loop in the TURP surgery. First, the ResNet-50 model was used to recognize the red light pattern appearing in the chipped frames of the surgery videos. Then, the proposed Res-Unet model was used to segment the areas with the red light pattern and remove these areas. Finally, the hue, saturation, and value color space were used to classify the four levels of the blood loss under the circumstances of non-red light pattern images. The experiments have shown that the proposed Res-Unet model achieves higher accuracy than other segmentation algorithms in classifying the images with the red and non-red lights, and is able to extract the red light patterns and effectively remove them in the TURP surgery images. The proposed approaches presented here are capable of obtaining the level classifications of blood loss, which are helpful for physicians in diagnosis. |
topic |
U-Net model ResNet-50 model HSV color space transurethral resection of the prostate (TURP) classification of bleeding area blood loss |
url |
https://www.mdpi.com/2076-3417/10/14/4908 |
work_keys_str_mv |
AT jianwenchen automatedclassificationofbloodlossfromtransurethralresectionoftheprostatesurgeryvideosusingdeeplearningtechnique AT wanjulin automatedclassificationofbloodlossfromtransurethralresectionoftheprostatesurgeryvideosusingdeeplearningtechnique AT chunyuanlin automatedclassificationofbloodlossfromtransurethralresectionoftheprostatesurgeryvideosusingdeeplearningtechnique AT chelunhung automatedclassificationofbloodlossfromtransurethralresectionoftheprostatesurgeryvideosusingdeeplearningtechnique AT chenpanghou automatedclassificationofbloodlossfromtransurethralresectionoftheprostatesurgeryvideosusingdeeplearningtechnique AT chingchecho automatedclassificationofbloodlossfromtransurethralresectionoftheprostatesurgeryvideosusingdeeplearningtechnique AT hongtsuyoung automatedclassificationofbloodlossfromtransurethralresectionoftheprostatesurgeryvideosusingdeeplearningtechnique AT chuanyitang automatedclassificationofbloodlossfromtransurethralresectionoftheprostatesurgeryvideosusingdeeplearningtechnique |
_version_ |
1724572946526109696 |