Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.

<h4>Background</h4>Onychomycosis is the most common nail disorder and is associated with diagnostic challenges. Emerging non-invasive, real-time techniques such as dermoscopy and deep convolutional neural networks have been proposed for the diagnosis of this condition. However, comparati...

Full description

Bibliographic Details
Main Authors: Young Jae Kim, Seung Seog Han, Hee Joo Yang, Sung Eun Chang
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2020-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0234334
id doaj-12fb5943046447269539667b469a629f
record_format Article
spelling doaj-12fb5943046447269539667b469a629f2021-03-04T12:26:22ZengPublic Library of Science (PLoS)PLoS ONE1932-62032020-01-01156e023433410.1371/journal.pone.0234334Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.Young Jae KimSeung Seog HanHee Joo YangSung Eun Chang<h4>Background</h4>Onychomycosis is the most common nail disorder and is associated with diagnostic challenges. Emerging non-invasive, real-time techniques such as dermoscopy and deep convolutional neural networks have been proposed for the diagnosis of this condition. However, comparative studies of the two tools in the diagnosis of onychomycosis have not previously been conducted.<h4>Objectives</h4>This study evaluated the diagnostic abilities of a deep neural network (http://nail.modelderm.com) and dermoscopic examination in patients with onychomycosis.<h4>Methods</h4>A prospective observational study was performed in patients presenting with dystrophic features in the toenails. Clinical photographs were taken by research assistants, and the ground truth was determined either by direct microscopy using the potassium hydroxide test or by fungal culture. Five board-certified dermatologists determined a diagnosis of onychomycosis using the clinical photographs. The diagnosis was also made using the algorithm and dermoscopic examination.<h4>Results</h4>A total of 90 patients (mean age, 55.3; male, 43.3%) assessed between September 2018 and July 2019 were included in the analysis. The detection of onychomycosis using the algorithm (AUC, 0.751; 95% CI, 0.646-0.856) and that by dermoscopy (AUC, 0.755; 95% CI, 0.654-0.855) were seen to be comparable (Delong's test; P = 0.952). The sensitivity and specificity of the algorithm at the operating point were 70.2% and 72.7%, respectively. The sensitivity and specificity of diagnosis by the five dermatologists were 73.0% and 49.7%, respectively. The Youden index of the algorithm (0.429) was also comparable to that of the dermatologists' diagnosis (0.230±0.176; Wilcoxon rank-sum test; P = 0.667).<h4>Conclusions</h4>As a standalone method, the algorithm analyzed photographs taken by non-physician and showed comparable accuracy for the diagnosis of onychomycosis to that made by experienced dermatologists and by dermoscopic examination. Large sample size and world-wide, multicentered studies should be investigated to prove the performance of the algorithm.https://doi.org/10.1371/journal.pone.0234334
collection DOAJ
language English
format Article
sources DOAJ
author Young Jae Kim
Seung Seog Han
Hee Joo Yang
Sung Eun Chang
spellingShingle Young Jae Kim
Seung Seog Han
Hee Joo Yang
Sung Eun Chang
Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.
PLoS ONE
author_facet Young Jae Kim
Seung Seog Han
Hee Joo Yang
Sung Eun Chang
author_sort Young Jae Kim
title Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.
title_short Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.
title_full Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.
title_fullStr Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.
title_full_unstemmed Prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.
title_sort prospective, comparative evaluation of a deep neural network and dermoscopy in the diagnosis of onychomycosis.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2020-01-01
description <h4>Background</h4>Onychomycosis is the most common nail disorder and is associated with diagnostic challenges. Emerging non-invasive, real-time techniques such as dermoscopy and deep convolutional neural networks have been proposed for the diagnosis of this condition. However, comparative studies of the two tools in the diagnosis of onychomycosis have not previously been conducted.<h4>Objectives</h4>This study evaluated the diagnostic abilities of a deep neural network (http://nail.modelderm.com) and dermoscopic examination in patients with onychomycosis.<h4>Methods</h4>A prospective observational study was performed in patients presenting with dystrophic features in the toenails. Clinical photographs were taken by research assistants, and the ground truth was determined either by direct microscopy using the potassium hydroxide test or by fungal culture. Five board-certified dermatologists determined a diagnosis of onychomycosis using the clinical photographs. The diagnosis was also made using the algorithm and dermoscopic examination.<h4>Results</h4>A total of 90 patients (mean age, 55.3; male, 43.3%) assessed between September 2018 and July 2019 were included in the analysis. The detection of onychomycosis using the algorithm (AUC, 0.751; 95% CI, 0.646-0.856) and that by dermoscopy (AUC, 0.755; 95% CI, 0.654-0.855) were seen to be comparable (Delong's test; P = 0.952). The sensitivity and specificity of the algorithm at the operating point were 70.2% and 72.7%, respectively. The sensitivity and specificity of diagnosis by the five dermatologists were 73.0% and 49.7%, respectively. The Youden index of the algorithm (0.429) was also comparable to that of the dermatologists' diagnosis (0.230±0.176; Wilcoxon rank-sum test; P = 0.667).<h4>Conclusions</h4>As a standalone method, the algorithm analyzed photographs taken by non-physician and showed comparable accuracy for the diagnosis of onychomycosis to that made by experienced dermatologists and by dermoscopic examination. Large sample size and world-wide, multicentered studies should be investigated to prove the performance of the algorithm.
url https://doi.org/10.1371/journal.pone.0234334
work_keys_str_mv AT youngjaekim prospectivecomparativeevaluationofadeepneuralnetworkanddermoscopyinthediagnosisofonychomycosis
AT seungseoghan prospectivecomparativeevaluationofadeepneuralnetworkanddermoscopyinthediagnosisofonychomycosis
AT heejooyang prospectivecomparativeevaluationofadeepneuralnetworkanddermoscopyinthediagnosisofonychomycosis
AT sungeunchang prospectivecomparativeevaluationofadeepneuralnetworkanddermoscopyinthediagnosisofonychomycosis
_version_ 1714802700444499968