CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES

Facial appearance has long been understood to offer insight into a person’s health. To an experienced clinician, atypical facial features may signify the presence of an underlying rare or genetic disease. Clinicians use their knowledge of how disease affects facial appearance along with the patient’...

Full description

Bibliographic Details
Main Authors: R. L. Palmer, P. Helmholz, G. Baynam
Format: Article
Language:English
Published: Copernicus Publications 2020-08-01
Series:The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
Online Access:https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/301/2020/isprs-archives-XLIII-B2-2020-301-2020.pdf
id doaj-e501287e47f44986a4993a2ca9dc80bf
record_format Article
spelling doaj-e501287e47f44986a4993a2ca9dc80bf2020-11-25T03:38:28ZengCopernicus PublicationsThe International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences1682-17502194-90342020-08-01XLIII-B2-202030130810.5194/isprs-archives-XLIII-B2-2020-301-2020CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGESR. L. Palmer0P. Helmholz1G. Baynam2G. Baynam3G. Baynam4School of Earth and Planetary Sciences, Faculty of Science and Engineering, Curtin University, Perth, WA 6845, AustraliaSchool of Earth and Planetary Sciences, Faculty of Science and Engineering, Curtin University, Perth, WA 6845, AustraliaSchool of Earth and Planetary Sciences, Faculty of Science and Engineering, Curtin University, Perth, WA 6845, AustraliaWestern Australian Register of Developmental Anomalies and Genetic Services of Western Australia, King Edward Memorial Hospital, Dept. of Health, Gov. of Western Australia, Perth WA 6008, AustraliaTelethon Kids Institute and Division of Paediatrics, Faculty of Health and Medical Sciences, UWA, Perth, WA 6008, AustraliaFacial appearance has long been understood to offer insight into a person’s health. To an experienced clinician, atypical facial features may signify the presence of an underlying rare or genetic disease. Clinicians use their knowledge of how disease affects facial appearance along with the patient’s physiological and behavioural traits, and their medical history, to determine a diagnosis. Specialist expertise and experience is needed to make a dysmorphological facial analysis. Key to this is accurately assessing how a face is significantly different in shape and/or growth compared to expected norms. Modern photogrammetric systems can acquire detailed 3D images of the face which can be used to conduct a facial analysis in software with greater precision than can be obtained in person. Measurements from 3D facial images are already used as an alternative to direct measurement using instruments such as tape measures, rulers, or callipers. However, the ability to take accurate measurements – whether virtual or not – presupposes the assessor’s facility to accurately place the endpoints of the measuring tool at the positions of standardised anatomical facial landmarks. In this paper, we formally introduce Cliniface – a free and open source application that uses a recently published highly precise method of detecting facial landmarks from 3D facial images by non-rigidly transforming an anthropometric mask (AM) to the target face. Inter-landmark measurements are then used to automatically identify facial traits that may be of clinical significance. Herein, we show how non-experts with minimal guidance can use Cliniface to extract facial anthropometrics from a 3D facial image at a level of accuracy comparable to an expert. We further show that Cliniface itself is able to extract the same measurements at a similar level of accuracy – completely automatically.https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/301/2020/isprs-archives-XLIII-B2-2020-301-2020.pdf
collection DOAJ
language English
format Article
sources DOAJ
author R. L. Palmer
P. Helmholz
G. Baynam
G. Baynam
G. Baynam
spellingShingle R. L. Palmer
P. Helmholz
G. Baynam
G. Baynam
G. Baynam
CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES
The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
author_facet R. L. Palmer
P. Helmholz
G. Baynam
G. Baynam
G. Baynam
author_sort R. L. Palmer
title CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES
title_short CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES
title_full CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES
title_fullStr CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES
title_full_unstemmed CLINIFACE: PHENOTYPIC VISUALISATION AND ANALYSIS USING NON-RIGID REGISTRATION OF 3D FACIAL IMAGES
title_sort cliniface: phenotypic visualisation and analysis using non-rigid registration of 3d facial images
publisher Copernicus Publications
series The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences
issn 1682-1750
2194-9034
publishDate 2020-08-01
description Facial appearance has long been understood to offer insight into a person’s health. To an experienced clinician, atypical facial features may signify the presence of an underlying rare or genetic disease. Clinicians use their knowledge of how disease affects facial appearance along with the patient’s physiological and behavioural traits, and their medical history, to determine a diagnosis. Specialist expertise and experience is needed to make a dysmorphological facial analysis. Key to this is accurately assessing how a face is significantly different in shape and/or growth compared to expected norms. Modern photogrammetric systems can acquire detailed 3D images of the face which can be used to conduct a facial analysis in software with greater precision than can be obtained in person. Measurements from 3D facial images are already used as an alternative to direct measurement using instruments such as tape measures, rulers, or callipers. However, the ability to take accurate measurements – whether virtual or not – presupposes the assessor’s facility to accurately place the endpoints of the measuring tool at the positions of standardised anatomical facial landmarks. In this paper, we formally introduce Cliniface – a free and open source application that uses a recently published highly precise method of detecting facial landmarks from 3D facial images by non-rigidly transforming an anthropometric mask (AM) to the target face. Inter-landmark measurements are then used to automatically identify facial traits that may be of clinical significance. Herein, we show how non-experts with minimal guidance can use Cliniface to extract facial anthropometrics from a 3D facial image at a level of accuracy comparable to an expert. We further show that Cliniface itself is able to extract the same measurements at a similar level of accuracy – completely automatically.
url https://www.int-arch-photogramm-remote-sens-spatial-inf-sci.net/XLIII-B2-2020/301/2020/isprs-archives-XLIII-B2-2020-301-2020.pdf
work_keys_str_mv AT rlpalmer clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages
AT phelmholz clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages
AT gbaynam clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages
AT gbaynam clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages
AT gbaynam clinifacephenotypicvisualisationandanalysisusingnonrigidregistrationof3dfacialimages
_version_ 1724542115461988352