Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis

Abstract Background Artificial intelligence (AI) is increasingly being used in medical imaging analysis. We aimed to evaluate the diagnostic accuracy of AI models used for detection of lymph node metastasis on pre-operative staging imaging for colorectal cancer. Methods A systematic review was condu...

Full description

Bibliographic Details
Main Authors: Sergei Bedrikovetski, Nagendra N. Dudi-Venkata, Hidde M. Kroon, Warren Seow, Ryash Vather, Gustavo Carneiro, James W. Moore, Tarik Sammour
Format: Article
Language:English
Published: BMC 2021-09-01
Series:BMC Cancer
Subjects:
Online Access:https://doi.org/10.1186/s12885-021-08773-w
id doaj-e7a310e29c6e4841a8c0d6c87518978c
record_format Article
spelling doaj-e7a310e29c6e4841a8c0d6c87518978c2021-10-03T11:44:02ZengBMCBMC Cancer1471-24072021-09-0121111010.1186/s12885-021-08773-wArtificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysisSergei Bedrikovetski0Nagendra N. Dudi-Venkata1Hidde M. Kroon2Warren Seow3Ryash Vather4Gustavo Carneiro5James W. Moore6Tarik Sammour7Discipline of Surgery, Faculty of Health and Medical Sciences, School of Medicine, University of AdelaideDiscipline of Surgery, Faculty of Health and Medical Sciences, School of Medicine, University of AdelaideDiscipline of Surgery, Faculty of Health and Medical Sciences, School of Medicine, University of AdelaideDiscipline of Surgery, Faculty of Health and Medical Sciences, School of Medicine, University of AdelaideDepartment of Surgery, Colorectal Unit, Royal Adelaide HospitalAustralian Institute for Machine Learning, School of Computer Science, University of AdelaideDiscipline of Surgery, Faculty of Health and Medical Sciences, School of Medicine, University of AdelaideDiscipline of Surgery, Faculty of Health and Medical Sciences, School of Medicine, University of AdelaideAbstract Background Artificial intelligence (AI) is increasingly being used in medical imaging analysis. We aimed to evaluate the diagnostic accuracy of AI models used for detection of lymph node metastasis on pre-operative staging imaging for colorectal cancer. Methods A systematic review was conducted according to PRISMA guidelines using a literature search of PubMed (MEDLINE), EMBASE, IEEE Xplore and the Cochrane Library for studies published from January 2010 to October 2020. Studies reporting on the accuracy of radiomics models and/or deep learning for the detection of lymph node metastasis in colorectal cancer by CT/MRI were included. Conference abstracts and studies reporting accuracy of image segmentation rather than nodal classification were excluded. The quality of the studies was assessed using a modified questionnaire of the QUADAS-2 criteria. Characteristics and diagnostic measures from each study were extracted. Pooling of area under the receiver operating characteristic curve (AUROC) was calculated in a meta-analysis. Results Seventeen eligible studies were identified for inclusion in the systematic review, of which 12 used radiomics models and five used deep learning models. High risk of bias was found in two studies and there was significant heterogeneity among radiomics papers (73.0%). In rectal cancer, there was a per-patient AUROC of 0.808 (0.739–0.876) and 0.917 (0.882–0.952) for radiomics and deep learning models, respectively. Both models performed better than the radiologists who had an AUROC of 0.688 (0.603 to 0.772). Similarly in colorectal cancer, radiomics models with a per-patient AUROC of 0.727 (0.633–0.821) outperformed the radiologist who had an AUROC of 0.676 (0.627–0.725). Conclusion AI models have the potential to predict lymph node metastasis more accurately in rectal and colorectal cancer, however, radiomics studies are heterogeneous and deep learning studies are scarce. Trial registration PROSPERO CRD42020218004 .https://doi.org/10.1186/s12885-021-08773-wColorectal cancerArtificial intelligenceRadiomicsDeep learningMachine learningmeta-analysis
collection DOAJ
language English
format Article
sources DOAJ
author Sergei Bedrikovetski
Nagendra N. Dudi-Venkata
Hidde M. Kroon
Warren Seow
Ryash Vather
Gustavo Carneiro
James W. Moore
Tarik Sammour
spellingShingle Sergei Bedrikovetski
Nagendra N. Dudi-Venkata
Hidde M. Kroon
Warren Seow
Ryash Vather
Gustavo Carneiro
James W. Moore
Tarik Sammour
Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis
BMC Cancer
Colorectal cancer
Artificial intelligence
Radiomics
Deep learning
Machine learning
meta-analysis
author_facet Sergei Bedrikovetski
Nagendra N. Dudi-Venkata
Hidde M. Kroon
Warren Seow
Ryash Vather
Gustavo Carneiro
James W. Moore
Tarik Sammour
author_sort Sergei Bedrikovetski
title Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis
title_short Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis
title_full Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis
title_fullStr Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis
title_full_unstemmed Artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis
title_sort artificial intelligence for pre-operative lymph node staging in colorectal cancer: a systematic review and meta-analysis
publisher BMC
series BMC Cancer
issn 1471-2407
publishDate 2021-09-01
description Abstract Background Artificial intelligence (AI) is increasingly being used in medical imaging analysis. We aimed to evaluate the diagnostic accuracy of AI models used for detection of lymph node metastasis on pre-operative staging imaging for colorectal cancer. Methods A systematic review was conducted according to PRISMA guidelines using a literature search of PubMed (MEDLINE), EMBASE, IEEE Xplore and the Cochrane Library for studies published from January 2010 to October 2020. Studies reporting on the accuracy of radiomics models and/or deep learning for the detection of lymph node metastasis in colorectal cancer by CT/MRI were included. Conference abstracts and studies reporting accuracy of image segmentation rather than nodal classification were excluded. The quality of the studies was assessed using a modified questionnaire of the QUADAS-2 criteria. Characteristics and diagnostic measures from each study were extracted. Pooling of area under the receiver operating characteristic curve (AUROC) was calculated in a meta-analysis. Results Seventeen eligible studies were identified for inclusion in the systematic review, of which 12 used radiomics models and five used deep learning models. High risk of bias was found in two studies and there was significant heterogeneity among radiomics papers (73.0%). In rectal cancer, there was a per-patient AUROC of 0.808 (0.739–0.876) and 0.917 (0.882–0.952) for radiomics and deep learning models, respectively. Both models performed better than the radiologists who had an AUROC of 0.688 (0.603 to 0.772). Similarly in colorectal cancer, radiomics models with a per-patient AUROC of 0.727 (0.633–0.821) outperformed the radiologist who had an AUROC of 0.676 (0.627–0.725). Conclusion AI models have the potential to predict lymph node metastasis more accurately in rectal and colorectal cancer, however, radiomics studies are heterogeneous and deep learning studies are scarce. Trial registration PROSPERO CRD42020218004 .
topic Colorectal cancer
Artificial intelligence
Radiomics
Deep learning
Machine learning
meta-analysis
url https://doi.org/10.1186/s12885-021-08773-w
work_keys_str_mv AT sergeibedrikovetski artificialintelligenceforpreoperativelymphnodestagingincolorectalcancerasystematicreviewandmetaanalysis
AT nagendrandudivenkata artificialintelligenceforpreoperativelymphnodestagingincolorectalcancerasystematicreviewandmetaanalysis
AT hiddemkroon artificialintelligenceforpreoperativelymphnodestagingincolorectalcancerasystematicreviewandmetaanalysis
AT warrenseow artificialintelligenceforpreoperativelymphnodestagingincolorectalcancerasystematicreviewandmetaanalysis
AT ryashvather artificialintelligenceforpreoperativelymphnodestagingincolorectalcancerasystematicreviewandmetaanalysis
AT gustavocarneiro artificialintelligenceforpreoperativelymphnodestagingincolorectalcancerasystematicreviewandmetaanalysis
AT jameswmoore artificialintelligenceforpreoperativelymphnodestagingincolorectalcancerasystematicreviewandmetaanalysis
AT tariksammour artificialintelligenceforpreoperativelymphnodestagingincolorectalcancerasystematicreviewandmetaanalysis
_version_ 1716845313387397120