CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES
Facial appearance has long been understood to offer insight into a person’s health. To an experienced clinician, atypical facial features may signify the presence of an underlying rare or genetic disease. Clinicians use their knowledge of how disease affects facial appearance along with the patient’...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Copernicus Publications
2020-08-01
|
Series: | The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
Online Access: | https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/301/2020/isprs-archives-XLIII-B2-2020-301-2020.pdf |
id |
doaj-e501287e47f44986a4993a2ca9dc80bf |
---|---|
record_format |
Article |
spelling |
doaj-e501287e47f44986a4993a2ca9dc80bf2020-11-25T03:38:28ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B2-202030130810.5194/isprs-archives-XLIII-B2-2020-301-2020CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGESR. L. Palmer0P. Helmholz1G. Baynam2G. Baynam3G. Baynam4School of Earth and Planetary Sciences, Faculty of Science and Engineering, Curtin University, Perth, WA 6845, AustraliaSchool of Earth and Planetary Sciences, Faculty of Science and Engineering, Curtin University, Perth, WA 6845, AustraliaSchool of Earth and Planetary Sciences, Faculty of Science and Engineering, Curtin University, Perth, WA 6845, AustraliaWestern Australian Register of Developmental Anomalies and Genetic Services of Western Australia, King Edward Memorial Hospital, Dept. of Health, Gov. of Western Australia, Perth WA 6008, AustraliaTelethon Kids Institute and Division of Paediatrics, Faculty of Health and Medical Sciences, UWA, Perth, WA 6008, AustraliaFacial appearance has long been understood to offer insight into a person’s health. To an experienced clinician, atypical facial features may signify the presence of an underlying rare or genetic disease. Clinicians use their knowledge of how disease affects facial appearance along with the patient’s physiological and behavioural traits, and their medical history, to determine a diagnosis. Specialist expertise and experience is needed to make a dysmorphological facial analysis. Key to this is accurately assessing how a face is significantly different in shape and/or growth compared to expected norms. Modern photogrammetric systems can acquire detailed 3D images of the face which can be used to conduct a facial analysis in software with greater precision than can be obtained in person. Measurements from 3D facial images are already used as an alternative to direct measurement using instruments such as tape measures, rulers, or callipers. However, the ability to take accurate measurements – whether virtual or not – presupposes the assessor’s facility to accurately place the endpoints of the measuring tool at the positions of standardised anatomical facial landmarks. In this paper, we formally introduce Cliniface – a free and open source application that uses a recently published highly precise method of detecting facial landmarks from 3D facial images by non-rigidly transforming an anthropometric mask (AM) to the target face. Inter-landmark measurements are then used to automatically identify facial traits that may be of clinical significance. Herein, we show how non-experts with minimal guidance can use Cliniface to extract facial anthropometrics from a 3D facial image at a level of accuracy comparable to an expert. We further show that Cliniface itself is able to extract the same measurements at a similar level of accuracy – completely automatically.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/301/2020/isprs-archives-XLIII-B2-2020-301-2020.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
R. L. Palmer P. Helmholz G. Baynam G. Baynam G. Baynam |
spellingShingle |
R. L. Palmer P. Helmholz G. Baynam G. Baynam G. Baynam CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
author_facet |
R. L. Palmer P. Helmholz G. Baynam G. Baynam G. Baynam |
author_sort |
R. L. Palmer |
title |
CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES |
title_short |
CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES |
title_full |
CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES |
title_fullStr |
CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES |
title_full_unstemmed |
CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES |
title_sort |
cliniface: phenotypic visualisation and analysis using non-rigid registration of 3d facial images |
publisher |
Copernicus Publications |
series |
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences |
issn |
1682-1750 2194-9034 |
publishDate |
2020-08-01 |
description |
Facial appearance has long been understood to offer insight into a person’s health. To an experienced clinician, atypical facial features may signify the presence of an underlying rare or genetic disease. Clinicians use their knowledge of how disease affects facial appearance along with the patient’s physiological and behavioural traits, and their medical history, to determine a diagnosis. Specialist expertise and experience is needed to make a dysmorphological facial analysis. Key to this is accurately assessing how a face is significantly different in shape and/or growth compared to expected norms. Modern photogrammetric systems can acquire detailed 3D images of the face which can be used to conduct a facial analysis in software with greater precision than can be obtained in person. Measurements from 3D facial images are already used as an alternative to direct measurement using instruments such as tape measures, rulers, or callipers. However, the ability to take accurate measurements – whether virtual or not – presupposes the assessor’s facility to accurately place the endpoints of the measuring tool at the positions of standardised anatomical facial landmarks. In this paper, we formally introduce Cliniface – a free and open source application that uses a recently published highly precise method of detecting facial landmarks from 3D facial images by non-rigidly transforming an anthropometric mask (AM) to the target face. Inter-landmark measurements are then used to automatically identify facial traits that may be of clinical significance. Herein, we show how non-experts with minimal guidance can use Cliniface to extract facial anthropometrics from a 3D facial image at a level of accuracy comparable to an expert. We further show that Cliniface itself is able to extract the same measurements at a similar level of accuracy – completely automatically. |
url |
https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/301/2020/isprs-archives-XLIII-B2-2020-301-2020.pdf |
work_keys_str_mv |
AT rlpalmer clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages AT phelmholz clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages AT gbaynam clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages AT gbaynam clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages AT gbaynam clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages |
_version_ |
1724542115461988352 |