Improving Skin-Disease Classification Based on Customized Loss Function Combined With Balanced Mini-Batch Logic and Real-Time Image Augmentation

Skin cancer is one of the most common cancers in the world. However, the disease is curable if detected in the beginning stage. Early detection of malignant lesions through accurate techniques and innovative technologies has a significant impact on reducing skin cancer mortality rates. Recently, art...

Full description

Bibliographic Details
Main Authors: Tri-Cong Pham, Antoine Doucet, Chi-Mai Luong, Cong-Thanh Tran, Van-Dung Hoang
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9167198/
id doaj-2e317fcda2314ed897f00e866d9ee062
record_format Article
spelling doaj-2e317fcda2314ed897f00e866d9ee0622021-03-30T04:23:33ZengIEEEIEEE Access2169-35362020-01-01815072515073710.1109/ACCESS.2020.30166539167198Improving Skin-Disease Classification Based on Customized Loss Function Combined With Balanced Mini-Batch Logic and Real-Time Image AugmentationTri-Cong Pham0https://orcid.org/0000-0002-5507-6454Antoine Doucet1https://orcid.org/0000-0001-6160-3356Chi-Mai Luong2Cong-Thanh Tran3https://orcid.org/0000-0003-1572-7248Van-Dung Hoang4School of Computer Science and Engineering, Thuyloi University, Hanoi, VietnamICT Laboratory, University of Science and Technology of Hanoi, Vietnam Academy of Science and Technology, Hanoi, VietnamICT Laboratory, University of Science and Technology of Hanoi, Vietnam Academy of Science and Technology, Hanoi, VietnamFPT Software, Hanoi, VietnamFaculty of Information Technology, Ton Duc Thang University, Ho Chi Minh City, VietnamSkin cancer is one of the most common cancers in the world. However, the disease is curable if detected in the beginning stage. Early detection of malignant lesions through accurate techniques and innovative technologies has a significant impact on reducing skin cancer mortality rates. Recently, artificial intelligence has come to the forefront to facilitate skin cancer diagnosis based on medical images. Many deep learning models have been studied and developed, but the imbalance of performance among classes in the multi-class classification is still a challenging problem. This study proposes a hybrid method for handling class imbalance of skin-disease classification. This method combines the data level method of balanced mini-batch logic followed by real-time image augmentation with the algorithm level method of designing new loss function. The training dataset includes 24,530 dermoscopic images of seven skin disease categories, which is by far the largest dataset of skin cancer. The performance metrics of six proposed methods are evaluated on a test dataset of 2,453 images. Our proposed EfficientNetB4-CLF model achieves the highest accuracy of 89.97% and also the highest mean recall of 86.13% with the smallest recalls' standard deviations of 7.60%. Compared to the original methods, our proposed solution not only surpasses 4.65% (86.13% vs 81.48%) of mean recalls but also reduces 4.24% of the recalls' standard deviations (from ±11.84% to ±7.60%). This result indicates that our hybrid method is highly effective in training the Deep CNN network on the skin-disease imbalanced dataset. It addresses the problem of slow learning of the minority classes in the networks by combining the data level method of balanced mini-batch logic followed by the real-time image augmentation with the algorithm level method of the newly designed loss function.https://ieeexplore.ieee.org/document/9167198/Skin diseaseimbalanced datasetdeep neural networkshybrid methodloss functionbalanced mini-batch logic
collection DOAJ
language English
format Article
sources DOAJ
author Tri-Cong Pham
Antoine Doucet
Chi-Mai Luong
Cong-Thanh Tran
Van-Dung Hoang
spellingShingle Tri-Cong Pham
Antoine Doucet
Chi-Mai Luong
Cong-Thanh Tran
Van-Dung Hoang
Improving Skin-Disease Classification Based on Customized Loss Function Combined With Balanced Mini-Batch Logic and Real-Time Image Augmentation
IEEE Access
Skin disease
imbalanced dataset
deep neural networks
hybrid method
loss function
balanced mini-batch logic
author_facet Tri-Cong Pham
Antoine Doucet
Chi-Mai Luong
Cong-Thanh Tran
Van-Dung Hoang
author_sort Tri-Cong Pham
title Improving Skin-Disease Classification Based on Customized Loss Function Combined With Balanced Mini-Batch Logic and Real-Time Image Augmentation
title_short Improving Skin-Disease Classification Based on Customized Loss Function Combined With Balanced Mini-Batch Logic and Real-Time Image Augmentation
title_full Improving Skin-Disease Classification Based on Customized Loss Function Combined With Balanced Mini-Batch Logic and Real-Time Image Augmentation
title_fullStr Improving Skin-Disease Classification Based on Customized Loss Function Combined With Balanced Mini-Batch Logic and Real-Time Image Augmentation
title_full_unstemmed Improving Skin-Disease Classification Based on Customized Loss Function Combined With Balanced Mini-Batch Logic and Real-Time Image Augmentation
title_sort improving skin-disease classification based on customized loss function combined with balanced mini-batch logic and real-time image augmentation
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Skin cancer is one of the most common cancers in the world. However, the disease is curable if detected in the beginning stage. Early detection of malignant lesions through accurate techniques and innovative technologies has a significant impact on reducing skin cancer mortality rates. Recently, artificial intelligence has come to the forefront to facilitate skin cancer diagnosis based on medical images. Many deep learning models have been studied and developed, but the imbalance of performance among classes in the multi-class classification is still a challenging problem. This study proposes a hybrid method for handling class imbalance of skin-disease classification. This method combines the data level method of balanced mini-batch logic followed by real-time image augmentation with the algorithm level method of designing new loss function. The training dataset includes 24,530 dermoscopic images of seven skin disease categories, which is by far the largest dataset of skin cancer. The performance metrics of six proposed methods are evaluated on a test dataset of 2,453 images. Our proposed EfficientNetB4-CLF model achieves the highest accuracy of 89.97% and also the highest mean recall of 86.13% with the smallest recalls' standard deviations of 7.60%. Compared to the original methods, our proposed solution not only surpasses 4.65% (86.13% vs 81.48%) of mean recalls but also reduces 4.24% of the recalls' standard deviations (from ±11.84% to ±7.60%). This result indicates that our hybrid method is highly effective in training the Deep CNN network on the skin-disease imbalanced dataset. It addresses the problem of slow learning of the minority classes in the networks by combining the data level method of balanced mini-batch logic followed by the real-time image augmentation with the algorithm level method of the newly designed loss function.
topic Skin disease
imbalanced dataset
deep neural networks
hybrid method
loss function
balanced mini-batch logic
url https://ieeexplore.ieee.org/document/9167198/
work_keys_str_mv AT tricongpham improvingskindiseaseclassificationbasedoncustomizedlossfunctioncombinedwithbalancedminibatchlogicandrealtimeimageaugmentation
AT antoinedoucet improvingskindiseaseclassificationbasedoncustomizedlossfunctioncombinedwithbalancedminibatchlogicandrealtimeimageaugmentation
AT chimailuong improvingskindiseaseclassificationbasedoncustomizedlossfunctioncombinedwithbalancedminibatchlogicandrealtimeimageaugmentation
AT congthanhtran improvingskindiseaseclassificationbasedoncustomizedlossfunctioncombinedwithbalancedminibatchlogicandrealtimeimageaugmentation
AT vandunghoang improvingskindiseaseclassificationbasedoncustomizedlossfunctioncombinedwithbalancedminibatchlogicandrealtimeimageaugmentation
_version_ 1724181849985515520