Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening
In the past two decades, several screening instruments were developed to detect toddlers who may be autistic both in clinical and unselected samples. Among others, the Quantitative CHecklist for Autism in Toddlers (Q-CHAT) is a quantitative and normally distributed measure of autistic traits that de...
Main Authors: | , , , , , , , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-03-01
|
Series: | Diagnostics |
Subjects: | |
Online Access: | https://www.mdpi.com/2075-4418/11/3/574 |
id |
doaj-b6fb304bfeac469cb5bad5d6eb3b4198 |
---|---|
record_format |
Article |
spelling |
doaj-b6fb304bfeac469cb5bad5d6eb3b41982021-03-23T00:06:21ZengMDPI AGDiagnostics2075-44182021-03-011157457410.3390/diagnostics11030574Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism ScreeningGennaro Tartarisco0Giovanni Cicceri1Davide Di Pietro2Elisa Leonardi3Stefania Aiello4Flavia Marino5Flavia Chiarotti6Antonella Gagliano7Giuseppe Maurizio Arduino8Fabio Apicella9Filippo Muratori10Dario Bruneo11Carrie Allison12Simon Baron Cohen13David Vagni14Giovanni Pioggia15Liliana Ruta16National Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyDepartment of Engineering, University of Messina, 98166 Messina, ItalyDepartment of Engineering, University of Messina, 98166 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyCenter for Behavioral Sciences and Mental Health, National Institute of Health, 00161 Rome, ItalyChild and Adolescent Neuropsychiatry Unit, Department of Biomedical Sciences, University of Cagliari and “G. Brotzu” Hospital Trust, 09124 Cagliari, ItalyCentro Autismo e Sindrome di Asperger ASLCN1, 12084 Mondovì, ItalyIRCCS Stella Maris Foundation, Calambrone, 56128 Pisa, ItalyIRCCS Stella Maris Foundation, Calambrone, 56128 Pisa, ItalyDepartment of Engineering, University of Messina, 98166 Messina, ItalyAutism Research Centre, Department of Psychiatry, University of Cambridge, Cambridge CB2 8AH, UKAutism Research Centre, Department of Psychiatry, University of Cambridge, Cambridge CB2 8AH, UKNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyNational Research Council of Italy (CNR)—Institute for Biomedical Research and Innovation (IRIB), 98164 Messina, ItalyIn the past two decades, several screening instruments were developed to detect toddlers who may be autistic both in clinical and unselected samples. Among others, the Quantitative CHecklist for Autism in Toddlers (Q-CHAT) is a quantitative and normally distributed measure of autistic traits that demonstrates good psychometric properties in different settings and cultures. Recently, machine learning (ML) has been applied to behavioral science to improve the classification performance of autism screening and diagnostic tools, but mainly in children, adolescents, and adults. In this study, we used ML to investigate the accuracy and reliability of the Q-CHAT in discriminating young autistic children from those without. Five different ML algorithms (random forest (RF), naïve Bayes (NB), support vector machine (SVM), logistic regression (LR), and K-nearest neighbors (KNN)) were applied to investigate the complete set of Q-CHAT items. Our results showed that ML achieved an overall accuracy of 90%, and the SVM was the most effective, being able to classify autism with 95% accuracy. Furthermore, using the SVM–recursive feature elimination (RFE) approach, we selected a subset of 14 items ensuring 91% accuracy, while 83% accuracy was obtained from the 3 best discriminating items in common to ours and the previously reported Q-CHAT-10. This evidence confirms the high performance and cross-cultural validity of the Q-CHAT, and supports the application of ML to create shorter and faster versions of the instrument, maintaining high classification accuracy, to be used as a quick, easy, and high-performance tool in primary-care settings.https://www.mdpi.com/2075-4418/11/3/574Q-CHATearly screeningmachine learningautism |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Gennaro Tartarisco Giovanni Cicceri Davide Di Pietro Elisa Leonardi Stefania Aiello Flavia Marino Flavia Chiarotti Antonella Gagliano Giuseppe Maurizio Arduino Fabio Apicella Filippo Muratori Dario Bruneo Carrie Allison Simon Baron Cohen David Vagni Giovanni Pioggia Liliana Ruta |
spellingShingle |
Gennaro Tartarisco Giovanni Cicceri Davide Di Pietro Elisa Leonardi Stefania Aiello Flavia Marino Flavia Chiarotti Antonella Gagliano Giuseppe Maurizio Arduino Fabio Apicella Filippo Muratori Dario Bruneo Carrie Allison Simon Baron Cohen David Vagni Giovanni Pioggia Liliana Ruta Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening Diagnostics Q-CHAT early screening machine learning autism |
author_facet |
Gennaro Tartarisco Giovanni Cicceri Davide Di Pietro Elisa Leonardi Stefania Aiello Flavia Marino Flavia Chiarotti Antonella Gagliano Giuseppe Maurizio Arduino Fabio Apicella Filippo Muratori Dario Bruneo Carrie Allison Simon Baron Cohen David Vagni Giovanni Pioggia Liliana Ruta |
author_sort |
Gennaro Tartarisco |
title |
Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening |
title_short |
Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening |
title_full |
Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening |
title_fullStr |
Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening |
title_full_unstemmed |
Use of Machine Learning to Investigate the Quantitative Checklist for Autism in Toddlers (Q-CHAT) towards Early Autism Screening |
title_sort |
use of machine learning to investigate the quantitative checklist for autism in toddlers (q-chat) towards early autism screening |
publisher |
MDPI AG |
series |
Diagnostics |
issn |
2075-4418 |
publishDate |
2021-03-01 |
description |
In the past two decades, several screening instruments were developed to detect toddlers who may be autistic both in clinical and unselected samples. Among others, the Quantitative CHecklist for Autism in Toddlers (Q-CHAT) is a quantitative and normally distributed measure of autistic traits that demonstrates good psychometric properties in different settings and cultures. Recently, machine learning (ML) has been applied to behavioral science to improve the classification performance of autism screening and diagnostic tools, but mainly in children, adolescents, and adults. In this study, we used ML to investigate the accuracy and reliability of the Q-CHAT in discriminating young autistic children from those without. Five different ML algorithms (random forest (RF), naïve Bayes (NB), support vector machine (SVM), logistic regression (LR), and K-nearest neighbors (KNN)) were applied to investigate the complete set of Q-CHAT items. Our results showed that ML achieved an overall accuracy of 90%, and the SVM was the most effective, being able to classify autism with 95% accuracy. Furthermore, using the SVM–recursive feature elimination (RFE) approach, we selected a subset of 14 items ensuring 91% accuracy, while 83% accuracy was obtained from the 3 best discriminating items in common to ours and the previously reported Q-CHAT-10. This evidence confirms the high performance and cross-cultural validity of the Q-CHAT, and supports the application of ML to create shorter and faster versions of the instrument, maintaining high classification accuracy, to be used as a quick, easy, and high-performance tool in primary-care settings. |
topic |
Q-CHAT early screening machine learning autism |
url |
https://www.mdpi.com/2075-4418/11/3/574 |
work_keys_str_mv |
AT gennarotartarisco useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT giovannicicceri useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT davidedipietro useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT elisaleonardi useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT stefaniaaiello useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT flaviamarino useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT flaviachiarotti useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT antonellagagliano useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT giuseppemaurizioarduino useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT fabioapicella useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT filippomuratori useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT dariobruneo useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT carrieallison useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT simonbaroncohen useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT davidvagni useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT giovannipioggia useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening AT lilianaruta useofmachinelearningtoinvestigatethequantitativechecklistforautismintoddlersqchattowardsearlyautismscreening |
_version_ |
1724206942774099968 |