COVID-FACT: A Fully-Automated Capsule Network-Based Framework for Identification of COVID-19 Cases from Chest CT Scans

The newly discovered Coronavirus Disease 2019 (COVID-19) has been globally spreading and causing hundreds of thousands of deaths around the world as of its first emergence in late 2019. The rapid outbreak of this disease has overwhelmed health care infrastructures and arises the need to allocate med...

Full description

Bibliographic Details
Main Authors: Shahin Heidarian, Parnian Afshar, Nastaran Enshaei, Farnoosh Naderkhani, Moezedin Javad Rafiee, Faranak Babaki Fard, Kaveh Samimi, S. Farokh Atashzar, Anastasia Oikonomou, Konstantinos N. Plataniotis, Arash Mohammadi
Format: Article
Language:English
Published: Frontiers Media S.A. 2021-05-01
Series:Frontiers in Artificial Intelligence
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/frai.2021.598932/full
id doaj-f49af0dcec87434e8826063b103f5c00
record_format Article
collection DOAJ
language English
format Article
sources DOAJ
author Shahin Heidarian
Parnian Afshar
Nastaran Enshaei
Farnoosh Naderkhani
Moezedin Javad Rafiee
Faranak Babaki Fard
Kaveh Samimi
S. Farokh Atashzar
S. Farokh Atashzar
Anastasia Oikonomou
Konstantinos N. Plataniotis
Arash Mohammadi
spellingShingle Shahin Heidarian
Parnian Afshar
Nastaran Enshaei
Farnoosh Naderkhani
Moezedin Javad Rafiee
Faranak Babaki Fard
Kaveh Samimi
S. Farokh Atashzar
S. Farokh Atashzar
Anastasia Oikonomou
Konstantinos N. Plataniotis
Arash Mohammadi
COVID-FACT: A Fully-Automated Capsule Network-Based Framework for Identification of COVID-19 Cases from Chest CT Scans
Frontiers in Artificial Intelligence
capsule networks
COVID-19
computed tomography scans
fully automated classification
deep learning
author_facet Shahin Heidarian
Parnian Afshar
Nastaran Enshaei
Farnoosh Naderkhani
Moezedin Javad Rafiee
Faranak Babaki Fard
Kaveh Samimi
S. Farokh Atashzar
S. Farokh Atashzar
Anastasia Oikonomou
Konstantinos N. Plataniotis
Arash Mohammadi
author_sort Shahin Heidarian
title COVID-FACT: A Fully-Automated Capsule Network-Based Framework for Identification of COVID-19 Cases from Chest CT Scans
title_short COVID-FACT: A Fully-Automated Capsule Network-Based Framework for Identification of COVID-19 Cases from Chest CT Scans
title_full COVID-FACT: A Fully-Automated Capsule Network-Based Framework for Identification of COVID-19 Cases from Chest CT Scans
title_fullStr COVID-FACT: A Fully-Automated Capsule Network-Based Framework for Identification of COVID-19 Cases from Chest CT Scans
title_full_unstemmed COVID-FACT: A Fully-Automated Capsule Network-Based Framework for Identification of COVID-19 Cases from Chest CT Scans
title_sort covid-fact: a fully-automated capsule network-based framework for identification of covid-19 cases from chest ct scans
publisher Frontiers Media S.A.
series Frontiers in Artificial Intelligence
issn 2624-8212
publishDate 2021-05-01
description The newly discovered Coronavirus Disease 2019 (COVID-19) has been globally spreading and causing hundreds of thousands of deaths around the world as of its first emergence in late 2019. The rapid outbreak of this disease has overwhelmed health care infrastructures and arises the need to allocate medical equipment and resources more efficiently. The early diagnosis of this disease will lead to the rapid separation of COVID-19 and non-COVID cases, which will be helpful for health care authorities to optimize resource allocation plans and early prevention of the disease. In this regard, a growing number of studies are investigating the capability of deep learning for early diagnosis of COVID-19. Computed tomography (CT) scans have shown distinctive features and higher sensitivity compared to other diagnostic tests, in particular the current gold standard, i.e., the Reverse Transcription Polymerase Chain Reaction (RT-PCR) test. Current deep learning-based algorithms are mainly developed based on Convolutional Neural Networks (CNNs) to identify COVID-19 pneumonia cases. CNNs, however, require extensive data augmentation and large datasets to identify detailed spatial relations between image instances. Furthermore, existing algorithms utilizing CT scans, either extend slice-level predictions to patient-level ones using a simple thresholding mechanism or rely on a sophisticated infection segmentation to identify the disease. In this paper, we propose a two-stage fully automated CT-based framework for identification of COVID-19 positive cases referred to as the “COVID-FACT”. COVID-FACT utilizes Capsule Networks, as its main building blocks and is, therefore, capable of capturing spatial information. In particular, to make the proposed COVID-FACT independent from sophisticated segmentations of the area of infection, slices demonstrating infection are detected at the first stage and the second stage is responsible for classifying patients into COVID and non-COVID cases. COVID-FACT detects slices with infection, and identifies positive COVID-19 cases using an in-house CT scan dataset, containing COVID-19, community acquired pneumonia, and normal cases. Based on our experiments, COVID-FACT achieves an accuracy of 90.82%, a sensitivity of 94.55%, a specificity of 86.04%, and an Area Under the Curve (AUC) of 0.98, while depending on far less supervision and annotation, in comparison to its counterparts.
topic capsule networks
COVID-19
computed tomography scans
fully automated classification
deep learning
url https://www.frontiersin.org/articles/10.3389/frai.2021.598932/full
work_keys_str_mv AT shahinheidarian covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT parnianafshar covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT nastaranenshaei covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT farnooshnaderkhani covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT moezedinjavadrafiee covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT faranakbabakifard covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT kavehsamimi covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT sfarokhatashzar covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT sfarokhatashzar covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT anastasiaoikonomou covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT konstantinosnplataniotis covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
AT arashmohammadi covidfactafullyautomatedcapsulenetworkbasedframeworkforidentificationofcovid19casesfromchestctscans
_version_ 1721427242624483328
spelling doaj-f49af0dcec87434e8826063b103f5c002021-05-25T15:04:06ZengFrontiers Media S.A.Frontiers in Artificial Intelligence2624-82122021-05-01410.3389/frai.2021.598932598932COVID-FACT: A Fully-Automated Capsule Network-Based Framework for Identification of COVID-19 Cases from Chest CT ScansShahin Heidarian0Parnian Afshar1Nastaran Enshaei2Farnoosh Naderkhani3Moezedin Javad Rafiee4Faranak Babaki Fard5Kaveh Samimi6S. Farokh Atashzar7S. Farokh Atashzar8Anastasia Oikonomou9Konstantinos N. Plataniotis10Arash Mohammadi11Department of Electrical and Computer Engineering, Concordia University, Montreal, QC, CanadaConcordia Institute for Information Systems Engineering (CIISE), Concordia University, Montreal, QC, CanadaConcordia Institute for Information Systems Engineering (CIISE), Concordia University, Montreal, QC, CanadaConcordia Institute for Information Systems Engineering (CIISE), Concordia University, Montreal, QC, CanadaDepartment of Medicine and Diagnostic Radiology, McGill University Health Center-Research Institute, Montreal, QC, CanadaBiomedical Sciences Department, Faculty of Medicine, University of Montreal, Montreal, QC, CanadaDepartment of Radiology, Iran University of Medical Science, Tehran, IranDepartment of Electrical and Computer Engineering, New York University, New York, NY, United StatesDepartment of Mechanical and Aerospace Engineering, New York University, New York, NY, United StatesDepartment of Medical Imaging, Sunnybrook Health Sciences Centre, University of Toronto, Toronto, ON, CanadaDepartment of Electrical and Computer Engineering, University of Toronto, Toronto, ON, CanadaConcordia Institute for Information Systems Engineering (CIISE), Concordia University, Montreal, QC, CanadaThe newly discovered Coronavirus Disease 2019 (COVID-19) has been globally spreading and causing hundreds of thousands of deaths around the world as of its first emergence in late 2019. The rapid outbreak of this disease has overwhelmed health care infrastructures and arises the need to allocate medical equipment and resources more efficiently. The early diagnosis of this disease will lead to the rapid separation of COVID-19 and non-COVID cases, which will be helpful for health care authorities to optimize resource allocation plans and early prevention of the disease. In this regard, a growing number of studies are investigating the capability of deep learning for early diagnosis of COVID-19. Computed tomography (CT) scans have shown distinctive features and higher sensitivity compared to other diagnostic tests, in particular the current gold standard, i.e., the Reverse Transcription Polymerase Chain Reaction (RT-PCR) test. Current deep learning-based algorithms are mainly developed based on Convolutional Neural Networks (CNNs) to identify COVID-19 pneumonia cases. CNNs, however, require extensive data augmentation and large datasets to identify detailed spatial relations between image instances. Furthermore, existing algorithms utilizing CT scans, either extend slice-level predictions to patient-level ones using a simple thresholding mechanism or rely on a sophisticated infection segmentation to identify the disease. In this paper, we propose a two-stage fully automated CT-based framework for identification of COVID-19 positive cases referred to as the “COVID-FACT”. COVID-FACT utilizes Capsule Networks, as its main building blocks and is, therefore, capable of capturing spatial information. In particular, to make the proposed COVID-FACT independent from sophisticated segmentations of the area of infection, slices demonstrating infection are detected at the first stage and the second stage is responsible for classifying patients into COVID and non-COVID cases. COVID-FACT detects slices with infection, and identifies positive COVID-19 cases using an in-house CT scan dataset, containing COVID-19, community acquired pneumonia, and normal cases. Based on our experiments, COVID-FACT achieves an accuracy of 90.82%, a sensitivity of 94.55%, a specificity of 86.04%, and an Area Under the Curve (AUC) of 0.98, while depending on far less supervision and annotation, in comparison to its counterparts.https://www.frontiersin.org/articles/10.3389/frai.2021.598932/fullcapsule networksCOVID-19computed tomography scansfully automated classificationdeep learning