Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial Intelligence

The aim of the present study was to investigate the diagnostic performance of a trained convolutional neural network (CNN) for detecting and categorizing fissure sealants from intraoral photographs using the expert standard as reference. An image set consisting of 2352 digital photographs from perma...

Full description

Bibliographic Details
Main Authors: Anne Schlickenrieder, Ole Meyer, Jule Schönewolf, Paula Engels, Reinhard Hickel, Volker Gruhn, Marc Hesenius, Jan Kühnisch
Format: Article
Language:English
Published: MDPI AG 2021-09-01
Series:Diagnostics
Subjects:
Online Access:https://www.mdpi.com/2075-4418/11/9/1608
id doaj-ac197d4200f54e9ba3f35d675c45f8bd
record_format Article
spelling doaj-ac197d4200f54e9ba3f35d675c45f8bd2021-09-25T23:59:06ZengMDPI AGDiagnostics2075-44182021-09-01111608160810.3390/diagnostics11091608Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial IntelligenceAnne Schlickenrieder0Ole Meyer1Jule Schönewolf2Paula Engels3Reinhard Hickel4Volker Gruhn5Marc Hesenius6Jan Kühnisch7Department of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, 80336 Munich, GermanyInstitute for Software Engineering, University of Duisburg-Essen, 45147 Essen, GermanyDepartment of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, 80336 Munich, GermanyDepartment of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, 80336 Munich, GermanyDepartment of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, 80336 Munich, GermanyInstitute for Software Engineering, University of Duisburg-Essen, 45147 Essen, GermanyInstitute for Software Engineering, University of Duisburg-Essen, 45147 Essen, GermanyDepartment of Conservative Dentistry and Periodontology, University Hospital, Ludwig-Maximilians University Munich, 80336 Munich, GermanyThe aim of the present study was to investigate the diagnostic performance of a trained convolutional neural network (CNN) for detecting and categorizing fissure sealants from intraoral photographs using the expert standard as reference. An image set consisting of 2352 digital photographs from permanent posterior teeth (461 unsealed tooth surfaces/1891 sealed surfaces) was divided into a training set (<i>n</i> = 1881/364/1517) and a test set (<i>n</i> = 471/97/374). All the images were scored according to the following categories: unsealed molar, intact, sufficient and insufficient sealant. Expert diagnoses served as the reference standard for cyclic training and repeated evaluation of the CNN (ResNeXt-101-32x8d), which was trained by using image augmentation and transfer learning. A statistical analysis was performed, including the calculation of contingency tables and areas under the receiver operating characteristic curve (AUC). The results showed that the CNN accurately detected sealants in 98.7% of all the test images, corresponding to an AUC of 0.996. The diagnostic accuracy and AUC were 89.6% and 0.951, respectively, for intact sealant; 83.2% and 0.888, respectively, for sufficient sealant; 92.4 and 0.942, respectively, for insufficient sealant. On the basis of the documented results, it was concluded that good agreement with the reference standard could be achieved for automatized sealant detection by using artificial intelligence methods. Nevertheless, further research is necessary to improve the model performance.https://www.mdpi.com/2075-4418/11/9/1608pit and fissure sealantscaries assessmentvisual examinationclinical evaluationartificial intelligenceconvolutional neural networks
collection DOAJ
language English
format Article
sources DOAJ
author Anne Schlickenrieder
Ole Meyer
Jule Schönewolf
Paula Engels
Reinhard Hickel
Volker Gruhn
Marc Hesenius
Jan Kühnisch
spellingShingle Anne Schlickenrieder
Ole Meyer
Jule Schönewolf
Paula Engels
Reinhard Hickel
Volker Gruhn
Marc Hesenius
Jan Kühnisch
Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial Intelligence
Diagnostics
pit and fissure sealants
caries assessment
visual examination
clinical evaluation
artificial intelligence
convolutional neural networks
author_facet Anne Schlickenrieder
Ole Meyer
Jule Schönewolf
Paula Engels
Reinhard Hickel
Volker Gruhn
Marc Hesenius
Jan Kühnisch
author_sort Anne Schlickenrieder
title Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial Intelligence
title_short Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial Intelligence
title_full Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial Intelligence
title_fullStr Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial Intelligence
title_full_unstemmed Automatized Detection and Categorization of Fissure Sealants from Intraoral Digital Photographs Using Artificial Intelligence
title_sort automatized detection and categorization of fissure sealants from intraoral digital photographs using artificial intelligence
publisher MDPI AG
series Diagnostics
issn 2075-4418
publishDate 2021-09-01
description The aim of the present study was to investigate the diagnostic performance of a trained convolutional neural network (CNN) for detecting and categorizing fissure sealants from intraoral photographs using the expert standard as reference. An image set consisting of 2352 digital photographs from permanent posterior teeth (461 unsealed tooth surfaces/1891 sealed surfaces) was divided into a training set (<i>n</i> = 1881/364/1517) and a test set (<i>n</i> = 471/97/374). All the images were scored according to the following categories: unsealed molar, intact, sufficient and insufficient sealant. Expert diagnoses served as the reference standard for cyclic training and repeated evaluation of the CNN (ResNeXt-101-32x8d), which was trained by using image augmentation and transfer learning. A statistical analysis was performed, including the calculation of contingency tables and areas under the receiver operating characteristic curve (AUC). The results showed that the CNN accurately detected sealants in 98.7% of all the test images, corresponding to an AUC of 0.996. The diagnostic accuracy and AUC were 89.6% and 0.951, respectively, for intact sealant; 83.2% and 0.888, respectively, for sufficient sealant; 92.4 and 0.942, respectively, for insufficient sealant. On the basis of the documented results, it was concluded that good agreement with the reference standard could be achieved for automatized sealant detection by using artificial intelligence methods. Nevertheless, further research is necessary to improve the model performance.
topic pit and fissure sealants
caries assessment
visual examination
clinical evaluation
artificial intelligence
convolutional neural networks
url https://www.mdpi.com/2075-4418/11/9/1608
work_keys_str_mv AT anneschlickenrieder automatizeddetectionandcategorizationoffissuresealantsfromintraoraldigitalphotographsusingartificialintelligence
AT olemeyer automatizeddetectionandcategorizationoffissuresealantsfromintraoraldigitalphotographsusingartificialintelligence
AT juleschonewolf automatizeddetectionandcategorizationoffissuresealantsfromintraoraldigitalphotographsusingartificialintelligence
AT paulaengels automatizeddetectionandcategorizationoffissuresealantsfromintraoraldigitalphotographsusingartificialintelligence
AT reinhardhickel automatizeddetectionandcategorizationoffissuresealantsfromintraoraldigitalphotographsusingartificialintelligence
AT volkergruhn automatizeddetectionandcategorizationoffissuresealantsfromintraoraldigitalphotographsusingartificialintelligence
AT marchesenius automatizeddetectionandcategorizationoffissuresealantsfromintraoraldigitalphotographsusingartificialintelligence
AT jankuhnisch automatizeddetectionandcategorizationoffissuresealantsfromintraoraldigitalphotographsusingartificialintelligence
_version_ 1717367405993263104