Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening

In the past two decades, several screening instruments were developed to detect toddlers who may be autistic both in clinical and unselected samples. Among others, the Quantitative CHecklist for Autism in Toddlers (Q-CHAT) is a quantitative and normally distributed measure of autistic traits that de...

Full description

Bibliographic Details
Main Authors: Gennaro Tartarisco, Giovanni Cicceri, Davide Di Pietro, Elisa Leonardi, Stefania Aiello, Flavia Marino, Flavia Chiarotti, Antonella Gagliano, Giuseppe Maurizio Arduino, Fabio Apicella, Filippo Muratori, Dario Bruneo, Carrie Allison, Simon Baron Cohen, David Vagni, Giovanni Pioggia, Liliana Ruta
Format: Article
Language:English
Published: MDPI AG 2021-03-01
Series:Diagnostics
Subjects:
Online Access:https://www.mdpi.com/2075-4418/11/3/574
id doaj-b6fb304bfeac469cb5bad5d6eb3b4198
record_format Article
spelling doaj-b6fb304bfeac469cb5bad5d6eb3b41982021-03-23T00:06:21ZengMDPI AGDiagnostics2075-44182021-03-011157457410.3390/diagnostics11030574Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism ScreeningGennaro Tartarisco0Giovanni Cicceri1Davide Di Pietro2Elisa Leonardi3Stefania Aiello4Flavia Marino5Flavia Chiarotti6Antonella Gagliano7Giuseppe Maurizio Arduino8Fabio Apicella9Filippo Muratori10Dario Bruneo11Carrie Allison12Simon Baron Cohen13David Vagni14Giovanni Pioggia15Liliana Ruta16National Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyDepartment of Engineering, University of Messina, 98166 Messina, ItalyDepartment of Engineering, University of Messina, 98166 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyCenter for Behavioral Sciences and Mental Health, National Institute of Health, 00161 Rome, ItalyChild and Adolescent Neuropsychiatry Unit, Department of Biomedical Sciences, University of Cagliari and “G. Brotzu” Hospital Trust, 09124 Cagliari, ItalyCentro Autismo e Sindrome di Asperger ASLCN1, 12084 Mondovì, ItalyIRCCS Stella Maris Foundation, Calambrone, 56128 Pisa, ItalyIRCCS Stella Maris Foundation, Calambrone, 56128 Pisa, ItalyDepartment of Engineering, University of Messina, 98166 Messina, ItalyAutism Research Centre, Department of Psychiatry, University of Cambridge, Cambridge CB2 8AH, UKAutism Research Centre, Department of Psychiatry, University of Cambridge, Cambridge CB2 8AH, UKNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyIn the past two decades, several screening instruments were developed to detect toddlers who may be autistic both in clinical and unselected samples. Among others, the Quantitative CHecklist for Autism in Toddlers (Q-CHAT) is a quantitative and normally distributed measure of autistic traits that demonstrates good psychometric properties in different settings and cultures. Recently, machine learning (ML) has been applied to behavioral science to improve the classification performance of autism screening and diagnostic tools, but mainly in children, adolescents, and adults. In this study, we used ML to investigate the accuracy and reliability of the Q-CHAT in discriminating young autistic children from those without. Five different ML algorithms (random forest (RF), naïve Bayes (NB), support vector machine (SVM), logistic regression (LR), and K-nearest neighbors (KNN)) were applied to investigate the complete set of Q-CHAT items. Our results showed that ML achieved an overall accuracy of 90%, and the SVM was the most effective, being able to classify autism with 95% accuracy. Furthermore, using the SVM–recursive feature elimination (RFE) approach, we selected a subset of 14 items ensuring 91% accuracy, while 83% accuracy was obtained from the 3 best discriminating items in common to ours and the previously reported Q-CHAT-10. This evidence confirms the high performance and cross-cultural validity of the Q-CHAT, and supports the application of ML to create shorter and faster versions of the instrument, maintaining high classification accuracy, to be used as a quick, easy, and high-performance tool in primary-care settings.https://www.mdpi.com/2075-4418/11/3/574Q-CHATearly screeningmachine learningautism
collection DOAJ
language English
format Article
sources DOAJ
author Gennaro Tartarisco
Giovanni Cicceri
Davide Di Pietro
Elisa Leonardi
Stefania Aiello
Flavia Marino
Flavia Chiarotti
Antonella Gagliano
Giuseppe Maurizio Arduino
Fabio Apicella
Filippo Muratori
Dario Bruneo
Carrie Allison
Simon Baron Cohen
David Vagni
Giovanni Pioggia
Liliana Ruta
spellingShingle Gennaro Tartarisco
Giovanni Cicceri
Davide Di Pietro
Elisa Leonardi
Stefania Aiello
Flavia Marino
Flavia Chiarotti
Antonella Gagliano
Giuseppe Maurizio Arduino
Fabio Apicella
Filippo Muratori
Dario Bruneo
Carrie Allison
Simon Baron Cohen
David Vagni
Giovanni Pioggia
Liliana Ruta
Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening
Diagnostics
Q-CHAT
early screening
machine learning
autism
author_facet Gennaro Tartarisco
Giovanni Cicceri
Davide Di Pietro
Elisa Leonardi
Stefania Aiello
Flavia Marino
Flavia Chiarotti
Antonella Gagliano
Giuseppe Maurizio Arduino
Fabio Apicella
Filippo Muratori
Dario Bruneo
Carrie Allison
Simon Baron Cohen
David Vagni
Giovanni Pioggia
Liliana Ruta
author_sort Gennaro Tartarisco
title Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening
title_short Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening
title_full Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening
title_fullStr Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening
title_full_unstemmed Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening
title_sort use of machine learning to investigate the quantitative checklist for autism in toddlers (q-chat) towards early autism screening
publisher MDPI AG
series Diagnostics
issn 2075-4418
publishDate 2021-03-01
description In the past two decades, several screening instruments were developed to detect toddlers who may be autistic both in clinical and unselected samples. Among others, the Quantitative CHecklist for Autism in Toddlers (Q-CHAT) is a quantitative and normally distributed measure of autistic traits that demonstrates good psychometric properties in different settings and cultures. Recently, machine learning (ML) has been applied to behavioral science to improve the classification performance of autism screening and diagnostic tools, but mainly in children, adolescents, and adults. In this study, we used ML to investigate the accuracy and reliability of the Q-CHAT in discriminating young autistic children from those without. Five different ML algorithms (random forest (RF), naïve Bayes (NB), support vector machine (SVM), logistic regression (LR), and K-nearest neighbors (KNN)) were applied to investigate the complete set of Q-CHAT items. Our results showed that ML achieved an overall accuracy of 90%, and the SVM was the most effective, being able to classify autism with 95% accuracy. Furthermore, using the SVM–recursive feature elimination (RFE) approach, we selected a subset of 14 items ensuring 91% accuracy, while 83% accuracy was obtained from the 3 best discriminating items in common to ours and the previously reported Q-CHAT-10. This evidence confirms the high performance and cross-cultural validity of the Q-CHAT, and supports the application of ML to create shorter and faster versions of the instrument, maintaining high classification accuracy, to be used as a quick, easy, and high-performance tool in primary-care settings.
topic Q-CHAT
early screening
machine learning
autism
url https://www.mdpi.com/2075-4418/11/3/574
work_keys_str_mv AT gennarotartarisco useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT giovannicicceri useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT davidedipietro useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT elisaleonardi useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT stefaniaaiello useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT flaviamarino useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT flaviachiarotti useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT antonellagagliano useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT giuseppemaurizioarduino useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT fabioapicella useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT filippomuratori useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT dariobruneo useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT carrieallison useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT simonbaroncohen useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT davidvagni useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT giovannipioggia useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
AT lilianaruta useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening
_version_ 1724206942774099968