Classification of melanocytic lesions in selected and whole-slide images via convolutional neural networks

Whole-slide images (WSIs) are a rich new source of biomedical imaging data. The use of automated systems to classify and segment WSIs has recently come to forefront of the pathology research community. While digital slides have obvious educational and clinical uses, their most exciting potential lie...

Full description

Bibliographic Details
Main Authors: Steven N Hart, William Flotte, Andrew P Norgan, Kabeer K Shah, Zachary R Buchan, Taofic Mounajjed, Thomas J Flotte
Format: Article
Language:English
Published: Wolters Kluwer Medknow Publications 2019-01-01
Series:Journal of Pathology Informatics
Subjects:
Online Access:http://www.jpathinformatics.org/article.asp?issn=2153-3539;year=2019;volume=10;issue=1;spage=5;epage=5;aulast=Hart
id doaj-af86f60124b449cf9855ce0a089b44ec
record_format Article
spelling doaj-af86f60124b449cf9855ce0a089b44ec2020-11-24T21:40:10ZengWolters Kluwer Medknow PublicationsJournal of Pathology Informatics2153-35392153-35392019-01-011015510.4103/jpi.jpi_32_18Classification of melanocytic lesions in selected and whole-slide images via convolutional neural networksSteven N HartWilliam FlotteAndrew P NorganKabeer K ShahZachary R BuchanTaofic MounajjedThomas J FlotteWhole-slide images (WSIs) are a rich new source of biomedical imaging data. The use of automated systems to classify and segment WSIs has recently come to forefront of the pathology research community. While digital slides have obvious educational and clinical uses, their most exciting potential lies in the application of quantitative computational tools to automate search tasks, assist in classic diagnostic classification tasks, and improve prognosis and theranostics. An essential step in enabling these advancements is to apply advances in machine learning and artificial intelligence from other fields to previously inaccessible pathology datasets, thereby enabling the application of new technologies to solve persistent diagnostic challenges in pathology. Here, we applied convolutional neural networks to differentiate between two forms of melanocytic lesions (Spitz and conventional). Classification accuracy at the patch level was 99.0%–2% when applied to WSI. Importantly, when the model was trained without careful image curation by a pathologist, the training took significantly longer and had lower overall performance. These results highlight the utility of augmented human intelligence in digital pathology applications, and the critical role pathologists will play in the evolution of computational pathology algorithms.http://www.jpathinformatics.org/article.asp?issn=2153-3539;year=2019;volume=10;issue=1;spage=5;epage=5;aulast=HartBioinformaticsdeep learningdermatologyimage analysis
collection DOAJ
language English
format Article
sources DOAJ
author Steven N Hart
William Flotte
Andrew P Norgan
Kabeer K Shah
Zachary R Buchan
Taofic Mounajjed
Thomas J Flotte
spellingShingle Steven N Hart
William Flotte
Andrew P Norgan
Kabeer K Shah
Zachary R Buchan
Taofic Mounajjed
Thomas J Flotte
Classification of melanocytic lesions in selected and whole-slide images via convolutional neural networks
Journal of Pathology Informatics
Bioinformatics
deep learning
dermatology
image analysis
author_facet Steven N Hart
William Flotte
Andrew P Norgan
Kabeer K Shah
Zachary R Buchan
Taofic Mounajjed
Thomas J Flotte
author_sort Steven N Hart
title Classification of melanocytic lesions in selected and whole-slide images via convolutional neural networks
title_short Classification of melanocytic lesions in selected and whole-slide images via convolutional neural networks
title_full Classification of melanocytic lesions in selected and whole-slide images via convolutional neural networks
title_fullStr Classification of melanocytic lesions in selected and whole-slide images via convolutional neural networks
title_full_unstemmed Classification of melanocytic lesions in selected and whole-slide images via convolutional neural networks
title_sort classification of melanocytic lesions in selected and whole-slide images via convolutional neural networks
publisher Wolters Kluwer Medknow Publications
series Journal of Pathology Informatics
issn 2153-3539
2153-3539
publishDate 2019-01-01
description Whole-slide images (WSIs) are a rich new source of biomedical imaging data. The use of automated systems to classify and segment WSIs has recently come to forefront of the pathology research community. While digital slides have obvious educational and clinical uses, their most exciting potential lies in the application of quantitative computational tools to automate search tasks, assist in classic diagnostic classification tasks, and improve prognosis and theranostics. An essential step in enabling these advancements is to apply advances in machine learning and artificial intelligence from other fields to previously inaccessible pathology datasets, thereby enabling the application of new technologies to solve persistent diagnostic challenges in pathology. Here, we applied convolutional neural networks to differentiate between two forms of melanocytic lesions (Spitz and conventional). Classification accuracy at the patch level was 99.0%–2% when applied to WSI. Importantly, when the model was trained without careful image curation by a pathologist, the training took significantly longer and had lower overall performance. These results highlight the utility of augmented human intelligence in digital pathology applications, and the critical role pathologists will play in the evolution of computational pathology algorithms.
topic Bioinformatics
deep learning
dermatology
image analysis
url http://www.jpathinformatics.org/article.asp?issn=2153-3539;year=2019;volume=10;issue=1;spage=5;epage=5;aulast=Hart
work_keys_str_mv AT stevennhart classificationofmelanocyticlesionsinselectedandwholeslideimagesviaconvolutionalneuralnetworks
AT williamflotte classificationofmelanocyticlesionsinselectedandwholeslideimagesviaconvolutionalneuralnetworks
AT andrewpnorgan classificationofmelanocyticlesionsinselectedandwholeslideimagesviaconvolutionalneuralnetworks
AT kabeerkshah classificationofmelanocyticlesionsinselectedandwholeslideimagesviaconvolutionalneuralnetworks
AT zacharyrbuchan classificationofmelanocyticlesionsinselectedandwholeslideimagesviaconvolutionalneuralnetworks
AT taoficmounajjed classificationofmelanocyticlesionsinselectedandwholeslideimagesviaconvolutionalneuralnetworks
AT thomasjflotte classificationofmelanocyticlesionsinselectedandwholeslideimagesviaconvolutionalneuralnetworks
_version_ 1725927714317139968