CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV

Abstract Tuberculosis (TB) is the leading cause of preventable death in HIV-positive patients, and yet often remains undiagnosed and untreated. Chest x-ray is often used to assist in diagnosis, yet this presents additional challenges due to atypical radiographic presentation and radiologist shortage...

Full description

Bibliographic Details
Main Authors: Pranav Rajpurkar, Chloe O’Connell, Amit Schechter, Nishit Asnani, Jason Li, Amirhossein Kiani, Robyn L. Ball, Marc Mendelson, Gary Maartens, Daniël J. van Hoving, Rulan Griesel, Andrew Y. Ng, Tom H. Boyles, Matthew P. Lungren
Format: Article
Language:English
Published: Nature Publishing Group 2020-09-01
Series:npj Digital Medicine
Online Access:https://doi.org/10.1038/s41746-020-00322-2
id doaj-7e39bc9219eb4fc4b15d71d68221dc99
record_format Article
spelling doaj-7e39bc9219eb4fc4b15d71d68221dc992021-09-12T11:07:35ZengNature Publishing Groupnpj Digital Medicine2398-63522020-09-01311810.1038/s41746-020-00322-2CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIVPranav Rajpurkar0Chloe O’Connell1Amit Schechter2Nishit Asnani3Jason Li4Amirhossein Kiani5Robyn L. Ball6Marc Mendelson7Gary Maartens8Daniël J. van Hoving9Rulan Griesel10Andrew Y. Ng11Tom H. Boyles12Matthew P. Lungren13Stanford University Department of Computer ScienceMassachusetts General Hospital Department of AnesthesiaStanford University Department of Computer ScienceStanford University Department of Computer ScienceStanford University Department of Computer ScienceStanford University Department of Computer ScienceStanford University AIMI CenterDepartment of Medicine, University of Cape TownDepartment of Medicine, University of Cape TownDepartment of Medicine, University of Cape TownDepartment of Medicine, University of Cape TownStanford University Department of Computer ScienceDepartment of Medicine, University of Cape TownStanford University AIMI CenterAbstract Tuberculosis (TB) is the leading cause of preventable death in HIV-positive patients, and yet often remains undiagnosed and untreated. Chest x-ray is often used to assist in diagnosis, yet this presents additional challenges due to atypical radiographic presentation and radiologist shortages in regions where co-infection is most common. We developed a deep learning algorithm to diagnose TB using clinical information and chest x-ray images from 677 HIV-positive patients with suspected TB from two hospitals in South Africa. We then sought to determine whether the algorithm could assist clinicians in the diagnosis of TB in HIV-positive patients as a web-based diagnostic assistant. Use of the algorithm resulted in a modest but statistically significant improvement in clinician accuracy (p = 0.002), increasing the mean clinician accuracy from 0.60 (95% CI 0.57, 0.63) without assistance to 0.65 (95% CI 0.60, 0.70) with assistance. However, the accuracy of assisted clinicians was significantly lower (p < 0.001) than that of the stand-alone algorithm, which had an accuracy of 0.79 (95% CI 0.77, 0.82) on the same unseen test cases. These results suggest that deep learning assistance may improve clinician accuracy in TB diagnosis using chest x-rays, which would be valuable in settings with a high burden of HIV/TB co-infection. Moreover, the high accuracy of the stand-alone algorithm suggests a potential value particularly in settings with a scarcity of radiological expertise.https://doi.org/10.1038/s41746-020-00322-2
collection DOAJ
language English
format Article
sources DOAJ
author Pranav Rajpurkar
Chloe O’Connell
Amit Schechter
Nishit Asnani
Jason Li
Amirhossein Kiani
Robyn L. Ball
Marc Mendelson
Gary Maartens
Daniël J. van Hoving
Rulan Griesel
Andrew Y. Ng
Tom H. Boyles
Matthew P. Lungren
spellingShingle Pranav Rajpurkar
Chloe O’Connell
Amit Schechter
Nishit Asnani
Jason Li
Amirhossein Kiani
Robyn L. Ball
Marc Mendelson
Gary Maartens
Daniël J. van Hoving
Rulan Griesel
Andrew Y. Ng
Tom H. Boyles
Matthew P. Lungren
CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV
npj Digital Medicine
author_facet Pranav Rajpurkar
Chloe O’Connell
Amit Schechter
Nishit Asnani
Jason Li
Amirhossein Kiani
Robyn L. Ball
Marc Mendelson
Gary Maartens
Daniël J. van Hoving
Rulan Griesel
Andrew Y. Ng
Tom H. Boyles
Matthew P. Lungren
author_sort Pranav Rajpurkar
title CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV
title_short CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV
title_full CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV
title_fullStr CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV
title_full_unstemmed CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV
title_sort chexaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with hiv
publisher Nature Publishing Group
series npj Digital Medicine
issn 2398-6352
publishDate 2020-09-01
description Abstract Tuberculosis (TB) is the leading cause of preventable death in HIV-positive patients, and yet often remains undiagnosed and untreated. Chest x-ray is often used to assist in diagnosis, yet this presents additional challenges due to atypical radiographic presentation and radiologist shortages in regions where co-infection is most common. We developed a deep learning algorithm to diagnose TB using clinical information and chest x-ray images from 677 HIV-positive patients with suspected TB from two hospitals in South Africa. We then sought to determine whether the algorithm could assist clinicians in the diagnosis of TB in HIV-positive patients as a web-based diagnostic assistant. Use of the algorithm resulted in a modest but statistically significant improvement in clinician accuracy (p = 0.002), increasing the mean clinician accuracy from 0.60 (95% CI 0.57, 0.63) without assistance to 0.65 (95% CI 0.60, 0.70) with assistance. However, the accuracy of assisted clinicians was significantly lower (p < 0.001) than that of the stand-alone algorithm, which had an accuracy of 0.79 (95% CI 0.77, 0.82) on the same unseen test cases. These results suggest that deep learning assistance may improve clinician accuracy in TB diagnosis using chest x-rays, which would be valuable in settings with a high burden of HIV/TB co-infection. Moreover, the high accuracy of the stand-alone algorithm suggests a potential value particularly in settings with a scarcity of radiological expertise.
url https://doi.org/10.1038/s41746-020-00322-2
work_keys_str_mv AT pranavrajpurkar chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT chloeoconnell chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT amitschechter chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT nishitasnani chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT jasonli chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT amirhosseinkiani chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT robynlball chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT marcmendelson chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT garymaartens chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT danieljvanhoving chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT rulangriesel chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT andrewyng chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT tomhboyles chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
AT matthewplungren chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv
_version_ 1717755974583844864