Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.
<h4>Objective</h4>Cohort selection is challenging for large-scale electronic health record (EHR) analyses, as International Classification of Diseases 9th edition (ICD-9) diagnostic codes are notoriously unreliable disease predictors. Our objective was to develop, evaluate, and validate...
Main Authors: | , , , , , , , , , , , , , , , , , , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2016-01-01
|
Series: | PLoS ONE |
Online Access: | https://doi.org/10.1371/journal.pone.0159621 |
id |
doaj-53c598ebe2b14c73afbb91101e9cdb16 |
---|---|
record_format |
Article |
spelling |
doaj-53c598ebe2b14c73afbb91101e9cdb162021-03-04T06:38:20ZengPublic Library of Science (PLoS)PLoS ONE1932-62032016-01-01117e015962110.1371/journal.pone.0159621Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.Todd LingrenPei ChenJoseph BochenekFinale Doshi-VelezPatty Manning-CourtneyJulie BickelLeah Wildenger WelchonsJudy ReinholdNicole BingYizhao NiWilliam BarbaresiFrank MentchMelissa BasfordJoshua DennyLyam VazquezCassandra PerryBahram NamjouHaijun QiuJohn ConnollyDebra AbramsIngrid A HolmBeth A CobbNataline LingrenImre SoltiHakon HakonarsonIsaac S KohaneJohn HarleyGuergana Savova<h4>Objective</h4>Cohort selection is challenging for large-scale electronic health record (EHR) analyses, as International Classification of Diseases 9th edition (ICD-9) diagnostic codes are notoriously unreliable disease predictors. Our objective was to develop, evaluate, and validate an automated algorithm for determining an Autism Spectrum Disorder (ASD) patient cohort from EHR. We demonstrate its utility via the largest investigation to date of the co-occurrence patterns of medical comorbidities in ASD.<h4>Methods</h4>We extracted ICD-9 codes and concepts derived from the clinical notes. A gold standard patient set was labeled by clinicians at Boston Children's Hospital (BCH) (N = 150) and Cincinnati Children's Hospital and Medical Center (CCHMC) (N = 152). Two algorithms were created: (1) rule-based implementing the ASD criteria from Diagnostic and Statistical Manual of Mental Diseases 4th edition, (2) predictive classifier. The positive predictive values (PPV) achieved by these algorithms were compared to an ICD-9 code baseline. We clustered the patients based on grouped ICD-9 codes and evaluated subgroups.<h4>Results</h4>The rule-based algorithm produced the best PPV: (a) BCH: 0.885 vs. 0.273 (baseline); (b) CCHMC: 0.840 vs. 0.645 (baseline); (c) combined: 0.864 vs. 0.460 (baseline). A validation at Children's Hospital of Philadelphia yielded 0.848 (PPV). Clustering analyses of comorbidities on the three-site large cohort (N = 20,658 ASD patients) identified psychiatric, developmental, and seizure disorder clusters.<h4>Conclusions</h4>In a large cross-institutional cohort, co-occurrence patterns of comorbidities in ASDs provide further hypothetical evidence for distinct courses in ASD. The proposed automated algorithms for cohort selection open avenues for other large-scale EHR studies and individualized treatment of ASD.https://doi.org/10.1371/journal.pone.0159621 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Todd Lingren Pei Chen Joseph Bochenek Finale Doshi-Velez Patty Manning-Courtney Julie Bickel Leah Wildenger Welchons Judy Reinhold Nicole Bing Yizhao Ni William Barbaresi Frank Mentch Melissa Basford Joshua Denny Lyam Vazquez Cassandra Perry Bahram Namjou Haijun Qiu John Connolly Debra Abrams Ingrid A Holm Beth A Cobb Nataline Lingren Imre Solti Hakon Hakonarson Isaac S Kohane John Harley Guergana Savova |
spellingShingle |
Todd Lingren Pei Chen Joseph Bochenek Finale Doshi-Velez Patty Manning-Courtney Julie Bickel Leah Wildenger Welchons Judy Reinhold Nicole Bing Yizhao Ni William Barbaresi Frank Mentch Melissa Basford Joshua Denny Lyam Vazquez Cassandra Perry Bahram Namjou Haijun Qiu John Connolly Debra Abrams Ingrid A Holm Beth A Cobb Nataline Lingren Imre Solti Hakon Hakonarson Isaac S Kohane John Harley Guergana Savova Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder. PLoS ONE |
author_facet |
Todd Lingren Pei Chen Joseph Bochenek Finale Doshi-Velez Patty Manning-Courtney Julie Bickel Leah Wildenger Welchons Judy Reinhold Nicole Bing Yizhao Ni William Barbaresi Frank Mentch Melissa Basford Joshua Denny Lyam Vazquez Cassandra Perry Bahram Namjou Haijun Qiu John Connolly Debra Abrams Ingrid A Holm Beth A Cobb Nataline Lingren Imre Solti Hakon Hakonarson Isaac S Kohane John Harley Guergana Savova |
author_sort |
Todd Lingren |
title |
Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder. |
title_short |
Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder. |
title_full |
Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder. |
title_fullStr |
Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder. |
title_full_unstemmed |
Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder. |
title_sort |
electronic health record based algorithm to identify patients with autism spectrum disorder. |
publisher |
Public Library of Science (PLoS) |
series |
PLoS ONE |
issn |
1932-6203 |
publishDate |
2016-01-01 |
description |
<h4>Objective</h4>Cohort selection is challenging for large-scale electronic health record (EHR) analyses, as International Classification of Diseases 9th edition (ICD-9) diagnostic codes are notoriously unreliable disease predictors. Our objective was to develop, evaluate, and validate an automated algorithm for determining an Autism Spectrum Disorder (ASD) patient cohort from EHR. We demonstrate its utility via the largest investigation to date of the co-occurrence patterns of medical comorbidities in ASD.<h4>Methods</h4>We extracted ICD-9 codes and concepts derived from the clinical notes. A gold standard patient set was labeled by clinicians at Boston Children's Hospital (BCH) (N = 150) and Cincinnati Children's Hospital and Medical Center (CCHMC) (N = 152). Two algorithms were created: (1) rule-based implementing the ASD criteria from Diagnostic and Statistical Manual of Mental Diseases 4th edition, (2) predictive classifier. The positive predictive values (PPV) achieved by these algorithms were compared to an ICD-9 code baseline. We clustered the patients based on grouped ICD-9 codes and evaluated subgroups.<h4>Results</h4>The rule-based algorithm produced the best PPV: (a) BCH: 0.885 vs. 0.273 (baseline); (b) CCHMC: 0.840 vs. 0.645 (baseline); (c) combined: 0.864 vs. 0.460 (baseline). A validation at Children's Hospital of Philadelphia yielded 0.848 (PPV). Clustering analyses of comorbidities on the three-site large cohort (N = 20,658 ASD patients) identified psychiatric, developmental, and seizure disorder clusters.<h4>Conclusions</h4>In a large cross-institutional cohort, co-occurrence patterns of comorbidities in ASDs provide further hypothetical evidence for distinct courses in ASD. The proposed automated algorithms for cohort selection open avenues for other large-scale EHR studies and individualized treatment of ASD. |
url |
https://doi.org/10.1371/journal.pone.0159621 |
work_keys_str_mv |
AT toddlingren electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT peichen electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT josephbochenek electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT finaledoshivelez electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT pattymanningcourtney electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT juliebickel electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT leahwildengerwelchons electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT judyreinhold electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT nicolebing electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT yizhaoni electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT williambarbaresi electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT frankmentch electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT melissabasford electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT joshuadenny electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT lyamvazquez electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT cassandraperry electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT bahramnamjou electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT haijunqiu electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT johnconnolly electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT debraabrams electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT ingridaholm electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT bethacobb electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT natalinelingren electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT imresolti electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT hakonhakonarson electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT isaacskohane electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT johnharley electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder AT guerganasavova electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder |
_version_ |
1714808388776361984 |