Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations

Abstract Realistic image generation is valuable in dental medicine, but still challenging for generative adversarial networks (GANs), which require large amounts of data to overcome the training instability. Thus, we generated lateral cephalogram X-ray images using a deep-learning-based progressive...

Full description

Bibliographic Details
Main Authors: Mingyu Kim, Sungchul Kim, Minjee Kim, Hyun-Jin Bae, Jae-Woo Park, Namkug Kim
Format: Article
Language:English
Published: Nature Publishing Group 2021-06-01
Series:Scientific Reports
Online Access:https://doi.org/10.1038/s41598-021-91965-y
id doaj-6c379c130b4846fba9ba730e1fc708a4
record_format Article
spelling doaj-6c379c130b4846fba9ba730e1fc708a42021-06-20T11:31:25ZengNature Publishing GroupScientific Reports2045-23222021-06-0111111010.1038/s41598-021-91965-yRealistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluationsMingyu Kim0Sungchul Kim1Minjee Kim2Hyun-Jin Bae3Jae-Woo Park4Namkug Kim5Department of Convergence Medicine, Asan Medical Center, College of Medicine, University of UlsanDepartment of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, College of Medicine, University of UlsanDepartment of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, College of Medicine, University of UlsanDepartment of Convergence Medicine, Asan Medical Center, College of Medicine, University of UlsanDepartment of Orthodontics, Kooalldam Dental HospitalDepartment of Convergence Medicine, Asan Medical Center, College of Medicine, University of UlsanAbstract Realistic image generation is valuable in dental medicine, but still challenging for generative adversarial networks (GANs), which require large amounts of data to overcome the training instability. Thus, we generated lateral cephalogram X-ray images using a deep-learning-based progressive growing GAN (PGGAN). The quality of generated images was evaluated by three methods. First, signal-to-noise ratios of real/synthesized images, evaluated at the posterior arch region of the first cervical vertebra, showed no statistically significant difference (t-test, p = 0.211). Second, the results of an image Turing test, conducted by non-orthodontists and orthodontists for 100 randomly chosen images, indicated that they had difficulty in distinguishing whether the image was real or synthesized. Third, cephalometric tracing with 42 landmark points detection, performed on real and synthesized images by two expert orthodontists, showed consistency with mean difference of 2.08 ± 1.02 mm. Furthermore, convolutional neural network-based classification tasks were used to classify skeletal patterns using a real dataset with class imbalance and a dataset balanced with synthesized images. The classification accuracy for the latter case was increased by 1.5%/3.3% at internal/external test sets, respectively. Thus, the cephalometric images generated by PGGAN are sufficiently realistic and have potential to application in various fields of dental medicine.https://doi.org/10.1038/s41598-021-91965-y
collection DOAJ
language English
format Article
sources DOAJ
author Mingyu Kim
Sungchul Kim
Minjee Kim
Hyun-Jin Bae
Jae-Woo Park
Namkug Kim
spellingShingle Mingyu Kim
Sungchul Kim
Minjee Kim
Hyun-Jin Bae
Jae-Woo Park
Namkug Kim
Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations
Scientific Reports
author_facet Mingyu Kim
Sungchul Kim
Minjee Kim
Hyun-Jin Bae
Jae-Woo Park
Namkug Kim
author_sort Mingyu Kim
title Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations
title_short Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations
title_full Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations
title_fullStr Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations
title_full_unstemmed Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations
title_sort realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations
publisher Nature Publishing Group
series Scientific Reports
issn 2045-2322
publishDate 2021-06-01
description Abstract Realistic image generation is valuable in dental medicine, but still challenging for generative adversarial networks (GANs), which require large amounts of data to overcome the training instability. Thus, we generated lateral cephalogram X-ray images using a deep-learning-based progressive growing GAN (PGGAN). The quality of generated images was evaluated by three methods. First, signal-to-noise ratios of real/synthesized images, evaluated at the posterior arch region of the first cervical vertebra, showed no statistically significant difference (t-test, p = 0.211). Second, the results of an image Turing test, conducted by non-orthodontists and orthodontists for 100 randomly chosen images, indicated that they had difficulty in distinguishing whether the image was real or synthesized. Third, cephalometric tracing with 42 landmark points detection, performed on real and synthesized images by two expert orthodontists, showed consistency with mean difference of 2.08 ± 1.02 mm. Furthermore, convolutional neural network-based classification tasks were used to classify skeletal patterns using a real dataset with class imbalance and a dataset balanced with synthesized images. The classification accuracy for the latter case was increased by 1.5%/3.3% at internal/external test sets, respectively. Thus, the cephalometric images generated by PGGAN are sufficiently realistic and have potential to application in various fields of dental medicine.
url https://doi.org/10.1038/s41598-021-91965-y
work_keys_str_mv AT mingyukim realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations
AT sungchulkim realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations
AT minjeekim realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations
AT hyunjinbae realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations
AT jaewoopark realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations
AT namkugkim realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations
_version_ 1721369995314724864