CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV
Abstract Tuberculosis (TB) is the leading cause of preventable death in HIV-positive patients, and yet often remains undiagnosed and untreated. Chest x-ray is often used to assist in diagnosis, yet this presents additional challenges due to atypical radiographic presentation and radiologist shortage...
Main Authors: | , , , , , , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Nature Publishing Group
2020-09-01
|
Series: | npj Digital Medicine |
Online Access: | https://doi.org/10.1038/s41746-020-00322-2 |
id |
doaj-7e39bc9219eb4fc4b15d71d68221dc99 |
---|---|
record_format |
Article |
spelling |
doaj-7e39bc9219eb4fc4b15d71d68221dc992021-09-12T11:07:35ZengNature Publishing Groupnpj Digital Medicine2398-63522020-09-01311810.1038/s41746-020-00322-2CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIVPranav Rajpurkar0Chloe O’Connell1Amit Schechter2Nishit Asnani3Jason Li4Amirhossein Kiani5Robyn L. Ball6Marc Mendelson7Gary Maartens8Daniël J. van Hoving9Rulan Griesel10Andrew Y. Ng11Tom H. Boyles12Matthew P. Lungren13Stanford University Department of Computer ScienceMassachusetts General Hospital Department of AnesthesiaStanford University Department of Computer ScienceStanford University Department of Computer ScienceStanford University Department of Computer ScienceStanford University Department of Computer ScienceStanford University AIMI CenterDepartment of Medicine, University of Cape TownDepartment of Medicine, University of Cape TownDepartment of Medicine, University of Cape TownDepartment of Medicine, University of Cape TownStanford University Department of Computer ScienceDepartment of Medicine, University of Cape TownStanford University AIMI CenterAbstract Tuberculosis (TB) is the leading cause of preventable death in HIV-positive patients, and yet often remains undiagnosed and untreated. Chest x-ray is often used to assist in diagnosis, yet this presents additional challenges due to atypical radiographic presentation and radiologist shortages in regions where co-infection is most common. We developed a deep learning algorithm to diagnose TB using clinical information and chest x-ray images from 677 HIV-positive patients with suspected TB from two hospitals in South Africa. We then sought to determine whether the algorithm could assist clinicians in the diagnosis of TB in HIV-positive patients as a web-based diagnostic assistant. Use of the algorithm resulted in a modest but statistically significant improvement in clinician accuracy (p = 0.002), increasing the mean clinician accuracy from 0.60 (95% CI 0.57, 0.63) without assistance to 0.65 (95% CI 0.60, 0.70) with assistance. However, the accuracy of assisted clinicians was significantly lower (p < 0.001) than that of the stand-alone algorithm, which had an accuracy of 0.79 (95% CI 0.77, 0.82) on the same unseen test cases. These results suggest that deep learning assistance may improve clinician accuracy in TB diagnosis using chest x-rays, which would be valuable in settings with a high burden of HIV/TB co-infection. Moreover, the high accuracy of the stand-alone algorithm suggests a potential value particularly in settings with a scarcity of radiological expertise.https://doi.org/10.1038/s41746-020-00322-2 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Pranav Rajpurkar Chloe O’Connell Amit Schechter Nishit Asnani Jason Li Amirhossein Kiani Robyn L. Ball Marc Mendelson Gary Maartens Daniël J. van Hoving Rulan Griesel Andrew Y. Ng Tom H. Boyles Matthew P. Lungren |
spellingShingle |
Pranav Rajpurkar Chloe O’Connell Amit Schechter Nishit Asnani Jason Li Amirhossein Kiani Robyn L. Ball Marc Mendelson Gary Maartens Daniël J. van Hoving Rulan Griesel Andrew Y. Ng Tom H. Boyles Matthew P. Lungren CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV npj Digital Medicine |
author_facet |
Pranav Rajpurkar Chloe O’Connell Amit Schechter Nishit Asnani Jason Li Amirhossein Kiani Robyn L. Ball Marc Mendelson Gary Maartens Daniël J. van Hoving Rulan Griesel Andrew Y. Ng Tom H. Boyles Matthew P. Lungren |
author_sort |
Pranav Rajpurkar |
title |
CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV |
title_short |
CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV |
title_full |
CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV |
title_fullStr |
CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV |
title_full_unstemmed |
CheXaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with HIV |
title_sort |
chexaid: deep learning assistance for physician diagnosis of tuberculosis using chest x-rays in patients with hiv |
publisher |
Nature Publishing Group |
series |
npj Digital Medicine |
issn |
2398-6352 |
publishDate |
2020-09-01 |
description |
Abstract Tuberculosis (TB) is the leading cause of preventable death in HIV-positive patients, and yet often remains undiagnosed and untreated. Chest x-ray is often used to assist in diagnosis, yet this presents additional challenges due to atypical radiographic presentation and radiologist shortages in regions where co-infection is most common. We developed a deep learning algorithm to diagnose TB using clinical information and chest x-ray images from 677 HIV-positive patients with suspected TB from two hospitals in South Africa. We then sought to determine whether the algorithm could assist clinicians in the diagnosis of TB in HIV-positive patients as a web-based diagnostic assistant. Use of the algorithm resulted in a modest but statistically significant improvement in clinician accuracy (p = 0.002), increasing the mean clinician accuracy from 0.60 (95% CI 0.57, 0.63) without assistance to 0.65 (95% CI 0.60, 0.70) with assistance. However, the accuracy of assisted clinicians was significantly lower (p < 0.001) than that of the stand-alone algorithm, which had an accuracy of 0.79 (95% CI 0.77, 0.82) on the same unseen test cases. These results suggest that deep learning assistance may improve clinician accuracy in TB diagnosis using chest x-rays, which would be valuable in settings with a high burden of HIV/TB co-infection. Moreover, the high accuracy of the stand-alone algorithm suggests a potential value particularly in settings with a scarcity of radiological expertise. |
url |
https://doi.org/10.1038/s41746-020-00322-2 |
work_keys_str_mv |
AT pranavrajpurkar chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT chloeoconnell chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT amitschechter chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT nishitasnani chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT jasonli chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT amirhosseinkiani chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT robynlball chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT marcmendelson chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT garymaartens chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT danieljvanhoving chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT rulangriesel chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT andrewyng chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT tomhboyles chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv AT matthewplungren chexaiddeeplearningassistanceforphysiciandiagnosisoftuberculosisusingchestxraysinpatientswithhiv |
_version_ |
1717755974583844864 |