Dermoscopy Image Classification Based on StyleGAN and DenseNet201

Melanoma is considered one of the most lethal skin cancers. However, skin lesion classification based on deep learning diagnostic techniques is a challenging task owing to the insufficiency of labeled skin lesion images and intraclass-imbalanced datasets. It is thus necessary to utilize data augment...

Full description

Bibliographic Details
Main Authors: Chen Zhao, Renjun Shuai, Li Ma, Wenjia Liu, Die Hu, Menglin Wu
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9316160/
id doaj-96e68241292848e29d462746621eee7e
record_format Article
spelling doaj-96e68241292848e29d462746621eee7e2021-03-30T14:48:20ZengIEEEIEEE Access2169-35362021-01-0198659867910.1109/ACCESS.2021.30496009316160Dermoscopy Image Classification Based on StyleGAN and DenseNet201Chen Zhao0https://orcid.org/0000-0002-8473-8816Renjun Shuai1https://orcid.org/0000-0003-1342-4075Li Ma2Wenjia Liu3Die Hu4Menglin Wu5College of Computer Science and Technology, Nanjing Tech University, Nanjing, ChinaCollege of Computer Science and Technology, Nanjing Tech University, Nanjing, ChinaNanjing Health Information Center, Nanjing, ChinaDepartment of Gastroenterology, The Affiliated Changzhou No.2 People’s Hospital of Nanjing Medical University, Changzhou, ChinaKey Laboratory for Software Engineering of Yunnan Province, Kunming, ChinaCollege of Computer Science and Technology, Nanjing Tech University, Nanjing, ChinaMelanoma is considered one of the most lethal skin cancers. However, skin lesion classification based on deep learning diagnostic techniques is a challenging task owing to the insufficiency of labeled skin lesion images and intraclass-imbalanced datasets. It is thus necessary to utilize data augmentation methods based on generative adversarial networks (GANs) to assist skin lesion classification and help dermatologists reach more accurate diagnostic decisions. Moreover, insufficient samples can cause a low classification accuracy in a model by using deep learning in medical diagnosis and reduce the accuracy of skin lesion classification. To solve the above problems, this paper proposes a new skin lesion image classification framework based on a skin lesion augmentation style-based GAN (SLA-StyleGAN) according to the basic architecture of style-based GANs and DenseNet201. The proposed framework redesigns the structure of style control and noise input in the original generator and reconstructs the discriminator to adjust the generator to efficiently synthesize high-quality skin lesion images. We introduce a new loss function that reduces the intraclass sample distance and expands the sample distance between different classes, which can improve the balanced multiclass accuracy (BMA). The experimental results show that our classification framework performs well on the ISIC2019 dataset, and the BMA reaches 93.64%. The proposed method improves the accuracy of skin lesion image classification, assists dermatologists in determining and diagnosing different types of skin lesions, and analyzes skin lesions at different stages as well as those that are difficult to distinguish.https://ieeexplore.ieee.org/document/9316160/StyleGANDenseNetmelanomaskin lesion classificationconvolutional neural networksdermoscopy images
collection DOAJ
language English
format Article
sources DOAJ
author Chen Zhao
Renjun Shuai
Li Ma
Wenjia Liu
Die Hu
Menglin Wu
spellingShingle Chen Zhao
Renjun Shuai
Li Ma
Wenjia Liu
Die Hu
Menglin Wu
Dermoscopy Image Classification Based on StyleGAN and DenseNet201
IEEE Access
StyleGAN
DenseNet
melanoma
skin lesion classification
convolutional neural networks
dermoscopy images
author_facet Chen Zhao
Renjun Shuai
Li Ma
Wenjia Liu
Die Hu
Menglin Wu
author_sort Chen Zhao
title Dermoscopy Image Classification Based on StyleGAN and DenseNet201
title_short Dermoscopy Image Classification Based on StyleGAN and DenseNet201
title_full Dermoscopy Image Classification Based on StyleGAN and DenseNet201
title_fullStr Dermoscopy Image Classification Based on StyleGAN and DenseNet201
title_full_unstemmed Dermoscopy Image Classification Based on StyleGAN and DenseNet201
title_sort dermoscopy image classification based on stylegan and densenet201
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description Melanoma is considered one of the most lethal skin cancers. However, skin lesion classification based on deep learning diagnostic techniques is a challenging task owing to the insufficiency of labeled skin lesion images and intraclass-imbalanced datasets. It is thus necessary to utilize data augmentation methods based on generative adversarial networks (GANs) to assist skin lesion classification and help dermatologists reach more accurate diagnostic decisions. Moreover, insufficient samples can cause a low classification accuracy in a model by using deep learning in medical diagnosis and reduce the accuracy of skin lesion classification. To solve the above problems, this paper proposes a new skin lesion image classification framework based on a skin lesion augmentation style-based GAN (SLA-StyleGAN) according to the basic architecture of style-based GANs and DenseNet201. The proposed framework redesigns the structure of style control and noise input in the original generator and reconstructs the discriminator to adjust the generator to efficiently synthesize high-quality skin lesion images. We introduce a new loss function that reduces the intraclass sample distance and expands the sample distance between different classes, which can improve the balanced multiclass accuracy (BMA). The experimental results show that our classification framework performs well on the ISIC2019 dataset, and the BMA reaches 93.64%. The proposed method improves the accuracy of skin lesion image classification, assists dermatologists in determining and diagnosing different types of skin lesions, and analyzes skin lesions at different stages as well as those that are difficult to distinguish.
topic StyleGAN
DenseNet
melanoma
skin lesion classification
convolutional neural networks
dermoscopy images
url https://ieeexplore.ieee.org/document/9316160/
work_keys_str_mv AT chenzhao dermoscopyimageclassificationbasedonstylegananddensenet201
AT renjunshuai dermoscopyimageclassificationbasedonstylegananddensenet201
AT lima dermoscopyimageclassificationbasedonstylegananddensenet201
AT wenjialiu dermoscopyimageclassificationbasedonstylegananddensenet201
AT diehu dermoscopyimageclassificationbasedonstylegananddensenet201
AT menglinwu dermoscopyimageclassificationbasedonstylegananddensenet201
_version_ 1724180463463956480