Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.

<h4>Objective</h4>Cohort selection is challenging for large-scale electronic health record (EHR) analyses, as International Classification of Diseases 9th edition (ICD-9) diagnostic codes are notoriously unreliable disease predictors. Our objective was to develop, evaluate, and validate...

Full description

Bibliographic Details
Main Authors: Todd Lingren, Pei Chen, Joseph Bochenek, Finale Doshi-Velez, Patty Manning-Courtney, Julie Bickel, Leah Wildenger Welchons, Judy Reinhold, Nicole Bing, Yizhao Ni, William Barbaresi, Frank Mentch, Melissa Basford, Joshua Denny, Lyam Vazquez, Cassandra Perry, Bahram Namjou, Haijun Qiu, John Connolly, Debra Abrams, Ingrid A Holm, Beth A Cobb, Nataline Lingren, Imre Solti, Hakon Hakonarson, Isaac S Kohane, John Harley, Guergana Savova
Format: Article
Language:English
Published: Public Library of Science (PLoS) 2016-01-01
Series:PLoS ONE
Online Access:https://doi.org/10.1371/journal.pone.0159621
id doaj-53c598ebe2b14c73afbb91101e9cdb16
record_format Article
spelling doaj-53c598ebe2b14c73afbb91101e9cdb162021-03-04T06:38:20ZengPublic Library of Science (PLoS)PLoS ONE1932-62032016-01-01117e015962110.1371/journal.pone.0159621Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.Todd LingrenPei ChenJoseph BochenekFinale Doshi-VelezPatty Manning-CourtneyJulie BickelLeah Wildenger WelchonsJudy ReinholdNicole BingYizhao NiWilliam BarbaresiFrank MentchMelissa BasfordJoshua DennyLyam VazquezCassandra PerryBahram NamjouHaijun QiuJohn ConnollyDebra AbramsIngrid A HolmBeth A CobbNataline LingrenImre SoltiHakon HakonarsonIsaac S KohaneJohn HarleyGuergana Savova<h4>Objective</h4>Cohort selection is challenging for large-scale electronic health record (EHR) analyses, as International Classification of Diseases 9th edition (ICD-9) diagnostic codes are notoriously unreliable disease predictors. Our objective was to develop, evaluate, and validate an automated algorithm for determining an Autism Spectrum Disorder (ASD) patient cohort from EHR. We demonstrate its utility via the largest investigation to date of the co-occurrence patterns of medical comorbidities in ASD.<h4>Methods</h4>We extracted ICD-9 codes and concepts derived from the clinical notes. A gold standard patient set was labeled by clinicians at Boston Children's Hospital (BCH) (N = 150) and Cincinnati Children's Hospital and Medical Center (CCHMC) (N = 152). Two algorithms were created: (1) rule-based implementing the ASD criteria from Diagnostic and Statistical Manual of Mental Diseases 4th edition, (2) predictive classifier. The positive predictive values (PPV) achieved by these algorithms were compared to an ICD-9 code baseline. We clustered the patients based on grouped ICD-9 codes and evaluated subgroups.<h4>Results</h4>The rule-based algorithm produced the best PPV: (a) BCH: 0.885 vs. 0.273 (baseline); (b) CCHMC: 0.840 vs. 0.645 (baseline); (c) combined: 0.864 vs. 0.460 (baseline). A validation at Children's Hospital of Philadelphia yielded 0.848 (PPV). Clustering analyses of comorbidities on the three-site large cohort (N = 20,658 ASD patients) identified psychiatric, developmental, and seizure disorder clusters.<h4>Conclusions</h4>In a large cross-institutional cohort, co-occurrence patterns of comorbidities in ASDs provide further hypothetical evidence for distinct courses in ASD. The proposed automated algorithms for cohort selection open avenues for other large-scale EHR studies and individualized treatment of ASD.https://doi.org/10.1371/journal.pone.0159621
collection DOAJ
language English
format Article
sources DOAJ
author Todd Lingren
Pei Chen
Joseph Bochenek
Finale Doshi-Velez
Patty Manning-Courtney
Julie Bickel
Leah Wildenger Welchons
Judy Reinhold
Nicole Bing
Yizhao Ni
William Barbaresi
Frank Mentch
Melissa Basford
Joshua Denny
Lyam Vazquez
Cassandra Perry
Bahram Namjou
Haijun Qiu
John Connolly
Debra Abrams
Ingrid A Holm
Beth A Cobb
Nataline Lingren
Imre Solti
Hakon Hakonarson
Isaac S Kohane
John Harley
Guergana Savova
spellingShingle Todd Lingren
Pei Chen
Joseph Bochenek
Finale Doshi-Velez
Patty Manning-Courtney
Julie Bickel
Leah Wildenger Welchons
Judy Reinhold
Nicole Bing
Yizhao Ni
William Barbaresi
Frank Mentch
Melissa Basford
Joshua Denny
Lyam Vazquez
Cassandra Perry
Bahram Namjou
Haijun Qiu
John Connolly
Debra Abrams
Ingrid A Holm
Beth A Cobb
Nataline Lingren
Imre Solti
Hakon Hakonarson
Isaac S Kohane
John Harley
Guergana Savova
Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.
PLoS ONE
author_facet Todd Lingren
Pei Chen
Joseph Bochenek
Finale Doshi-Velez
Patty Manning-Courtney
Julie Bickel
Leah Wildenger Welchons
Judy Reinhold
Nicole Bing
Yizhao Ni
William Barbaresi
Frank Mentch
Melissa Basford
Joshua Denny
Lyam Vazquez
Cassandra Perry
Bahram Namjou
Haijun Qiu
John Connolly
Debra Abrams
Ingrid A Holm
Beth A Cobb
Nataline Lingren
Imre Solti
Hakon Hakonarson
Isaac S Kohane
John Harley
Guergana Savova
author_sort Todd Lingren
title Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.
title_short Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.
title_full Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.
title_fullStr Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.
title_full_unstemmed Electronic Health Record Based Algorithm to Identify Patients with Autism Spectrum Disorder.
title_sort electronic health record based algorithm to identify patients with autism spectrum disorder.
publisher Public Library of Science (PLoS)
series PLoS ONE
issn 1932-6203
publishDate 2016-01-01
description <h4>Objective</h4>Cohort selection is challenging for large-scale electronic health record (EHR) analyses, as International Classification of Diseases 9th edition (ICD-9) diagnostic codes are notoriously unreliable disease predictors. Our objective was to develop, evaluate, and validate an automated algorithm for determining an Autism Spectrum Disorder (ASD) patient cohort from EHR. We demonstrate its utility via the largest investigation to date of the co-occurrence patterns of medical comorbidities in ASD.<h4>Methods</h4>We extracted ICD-9 codes and concepts derived from the clinical notes. A gold standard patient set was labeled by clinicians at Boston Children's Hospital (BCH) (N = 150) and Cincinnati Children's Hospital and Medical Center (CCHMC) (N = 152). Two algorithms were created: (1) rule-based implementing the ASD criteria from Diagnostic and Statistical Manual of Mental Diseases 4th edition, (2) predictive classifier. The positive predictive values (PPV) achieved by these algorithms were compared to an ICD-9 code baseline. We clustered the patients based on grouped ICD-9 codes and evaluated subgroups.<h4>Results</h4>The rule-based algorithm produced the best PPV: (a) BCH: 0.885 vs. 0.273 (baseline); (b) CCHMC: 0.840 vs. 0.645 (baseline); (c) combined: 0.864 vs. 0.460 (baseline). A validation at Children's Hospital of Philadelphia yielded 0.848 (PPV). Clustering analyses of comorbidities on the three-site large cohort (N = 20,658 ASD patients) identified psychiatric, developmental, and seizure disorder clusters.<h4>Conclusions</h4>In a large cross-institutional cohort, co-occurrence patterns of comorbidities in ASDs provide further hypothetical evidence for distinct courses in ASD. The proposed automated algorithms for cohort selection open avenues for other large-scale EHR studies and individualized treatment of ASD.
url https://doi.org/10.1371/journal.pone.0159621
work_keys_str_mv AT toddlingren electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT peichen electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT josephbochenek electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT finaledoshivelez electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT pattymanningcourtney electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT juliebickel electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT leahwildengerwelchons electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT judyreinhold electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT nicolebing electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT yizhaoni electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT williambarbaresi electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT frankmentch electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT melissabasford electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT joshuadenny electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT lyamvazquez electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT cassandraperry electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT bahramnamjou electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT haijunqiu electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT johnconnolly electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT debraabrams electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT ingridaholm electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT bethacobb electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT natalinelingren electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT imresolti electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT hakonhakonarson electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT isaacskohane electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT johnharley electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
AT guerganasavova electronichealthrecordbasedalgorithmtoidentifypatientswithautismspectrumdisorder
_version_ 1714808388776361984