Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations
Abstract Realistic image generation is valuable in dental medicine, but still challenging for generative adversarial networks (GANs), which require large amounts of data to overcome the training instability. Thus, we generated lateral cephalogram X-ray images using a deep-learning-based progressive...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Nature Publishing Group
2021-06-01
|
Series: | Scientific Reports |
Online Access: | https://doi.org/10.1038/s41598-021-91965-y |
id |
doaj-6c379c130b4846fba9ba730e1fc708a4 |
---|---|
record_format |
Article |
spelling |
doaj-6c379c130b4846fba9ba730e1fc708a42021-06-20T11:31:25ZengNature Publishing GroupScientific Reports2045-23222021-06-0111111010.1038/s41598-021-91965-yRealistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluationsMingyu Kim0Sungchul Kim1Minjee Kim2Hyun-Jin Bae3Jae-Woo Park4Namkug Kim5Department of Convergence Medicine, Asan Medical Center, College of Medicine, University of UlsanDepartment of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, College of Medicine, University of UlsanDepartment of Biomedical Engineering, Asan Medical Institute of Convergence Science and Technology, Asan Medical Center, College of Medicine, University of UlsanDepartment of Convergence Medicine, Asan Medical Center, College of Medicine, University of UlsanDepartment of Orthodontics, Kooalldam Dental HospitalDepartment of Convergence Medicine, Asan Medical Center, College of Medicine, University of UlsanAbstract Realistic image generation is valuable in dental medicine, but still challenging for generative adversarial networks (GANs), which require large amounts of data to overcome the training instability. Thus, we generated lateral cephalogram X-ray images using a deep-learning-based progressive growing GAN (PGGAN). The quality of generated images was evaluated by three methods. First, signal-to-noise ratios of real/synthesized images, evaluated at the posterior arch region of the first cervical vertebra, showed no statistically significant difference (t-test, p = 0.211). Second, the results of an image Turing test, conducted by non-orthodontists and orthodontists for 100 randomly chosen images, indicated that they had difficulty in distinguishing whether the image was real or synthesized. Third, cephalometric tracing with 42 landmark points detection, performed on real and synthesized images by two expert orthodontists, showed consistency with mean difference of 2.08 ± 1.02 mm. Furthermore, convolutional neural network-based classification tasks were used to classify skeletal patterns using a real dataset with class imbalance and a dataset balanced with synthesized images. The classification accuracy for the latter case was increased by 1.5%/3.3% at internal/external test sets, respectively. Thus, the cephalometric images generated by PGGAN are sufficiently realistic and have potential to application in various fields of dental medicine.https://doi.org/10.1038/s41598-021-91965-y |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Mingyu Kim Sungchul Kim Minjee Kim Hyun-Jin Bae Jae-Woo Park Namkug Kim |
spellingShingle |
Mingyu Kim Sungchul Kim Minjee Kim Hyun-Jin Bae Jae-Woo Park Namkug Kim Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations Scientific Reports |
author_facet |
Mingyu Kim Sungchul Kim Minjee Kim Hyun-Jin Bae Jae-Woo Park Namkug Kim |
author_sort |
Mingyu Kim |
title |
Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations |
title_short |
Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations |
title_full |
Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations |
title_fullStr |
Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations |
title_full_unstemmed |
Realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations |
title_sort |
realistic high-resolution lateral cephalometric radiography generated by progressive growing generative adversarial network and quality evaluations |
publisher |
Nature Publishing Group |
series |
Scientific Reports |
issn |
2045-2322 |
publishDate |
2021-06-01 |
description |
Abstract Realistic image generation is valuable in dental medicine, but still challenging for generative adversarial networks (GANs), which require large amounts of data to overcome the training instability. Thus, we generated lateral cephalogram X-ray images using a deep-learning-based progressive growing GAN (PGGAN). The quality of generated images was evaluated by three methods. First, signal-to-noise ratios of real/synthesized images, evaluated at the posterior arch region of the first cervical vertebra, showed no statistically significant difference (t-test, p = 0.211). Second, the results of an image Turing test, conducted by non-orthodontists and orthodontists for 100 randomly chosen images, indicated that they had difficulty in distinguishing whether the image was real or synthesized. Third, cephalometric tracing with 42 landmark points detection, performed on real and synthesized images by two expert orthodontists, showed consistency with mean difference of 2.08 ± 1.02 mm. Furthermore, convolutional neural network-based classification tasks were used to classify skeletal patterns using a real dataset with class imbalance and a dataset balanced with synthesized images. The classification accuracy for the latter case was increased by 1.5%/3.3% at internal/external test sets, respectively. Thus, the cephalometric images generated by PGGAN are sufficiently realistic and have potential to application in various fields of dental medicine. |
url |
https://doi.org/10.1038/s41598-021-91965-y |
work_keys_str_mv |
AT mingyukim realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations AT sungchulkim realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations AT minjeekim realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations AT hyunjinbae realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations AT jaewoopark realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations AT namkugkim realistichighresolutionlateralcephalometricradiographygeneratedbyprogressivegrowinggenerativeadversarialnetworkandqualityevaluations |
_version_ |
1721369995314724864 |