Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning

Surgical resection of head and neck (H and N) squamous cell carcinoma (SCC) may yield inadequate surgical cancer margins in 10 to 20% of cases. This study investigates the performance of label-free, reflectance-based hyperspectral imaging (HSI) and autofluorescence imaging for SCC detection at the c...

Full description

Bibliographic Details
Main Authors: Martin Halicek, James D. Dormer, James V. Little, Amy Y. Chen, Larry Myers, Baran D. Sumer, Baowei Fei
Format: Article
Language:English
Published: MDPI AG 2019-09-01
Series:Cancers
Subjects:
Online Access:https://www.mdpi.com/2072-6694/11/9/1367
id doaj-4c2da9cbc63b4d7aae92af35e2694b52
record_format Article
spelling doaj-4c2da9cbc63b4d7aae92af35e2694b522020-11-25T01:25:44ZengMDPI AGCancers2072-66942019-09-01119136710.3390/cancers11091367cancers11091367Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep LearningMartin Halicek0James D. Dormer1James V. Little2Amy Y. Chen3Larry Myers4Baran D. Sumer5Baowei Fei6Department of Bioengineering, The University of Texas at Dallas, Richardson, TX 75080, USADepartment of Bioengineering, The University of Texas at Dallas, Richardson, TX 75080, USADepartment of Pathology and Laboratory Medicine, Emory University School of Medicine, Atlanta, GA 30322, USADepartment of Otolaryngology, Emory University School of Medicine, Atlanta, GA 30322, USADepartment of Otolaryngology, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USADepartment of Otolaryngology, The University of Texas Southwestern Medical Center, Dallas, TX 75390, USADepartment of Bioengineering, The University of Texas at Dallas, Richardson, TX 75080, USASurgical resection of head and neck (H and N) squamous cell carcinoma (SCC) may yield inadequate surgical cancer margins in 10 to 20% of cases. This study investigates the performance of label-free, reflectance-based hyperspectral imaging (HSI) and autofluorescence imaging for SCC detection at the cancer margin in excised tissue specimens from 102 patients and uses fluorescent dyes for comparison. Fresh surgical specimens (<i>n</i> = 293) were collected during H and N SCC resections (<i>n</i> = 102). The tissue specimens were imaged with reflectance-based HSI and autofluorescence imaging and afterwards with two fluorescent dyes for comparison. A histopathological ground truth was made. Deep learning tools were developed to detect SCC with new patient samples (inter-patient) and machine learning for intra-patient tissue samples. Area under the curve (AUC) of the receiver-operator characteristic was used as the main evaluation metric. Additionally, the performance was estimated in mm increments circumferentially from the tumor-normal margin. In intra-patient experiments, HSI classified conventional SCC with an AUC of 0.82 up to 3 mm from the cancer margin, which was more accurate than proflavin dye and autofluorescence (both <i>p</i> &lt; 0.05). Intra-patient autofluorescence imaging detected human papilloma virus positive (HPV+) SCC with an AUC of 0.99 at 3 mm and greater accuracy than proflavin dye (<i>p</i> &lt; 0.05). The inter-patient results showed that reflectance-based HSI and autofluorescence imaging outperformed proflavin dye and standard red, green, and blue (RGB) images (<i>p</i> &lt; 0.05). In new patients, HSI detected conventional SCC in the larynx, oropharynx, and nasal cavity with 0.85&#8722;0.95 AUC score, and autofluorescence imaging detected HPV+ SCC in tonsillar tissue with 0.91 AUC score. This study demonstrates that label-free, reflectance-based HSI and autofluorescence imaging methods can accurately detect the cancer margin in ex-vivo specimens within minutes. This non-ionizing optical imaging modality could aid surgeons and reduce inadequate surgical margins during SCC resections.https://www.mdpi.com/2072-6694/11/9/1367hyperspectral imaginghead and neck cancersquamous cell carcinomadeep learningconvolutional neural network
collection DOAJ
language English
format Article
sources DOAJ
author Martin Halicek
James D. Dormer
James V. Little
Amy Y. Chen
Larry Myers
Baran D. Sumer
Baowei Fei
spellingShingle Martin Halicek
James D. Dormer
James V. Little
Amy Y. Chen
Larry Myers
Baran D. Sumer
Baowei Fei
Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning
Cancers
hyperspectral imaging
head and neck cancer
squamous cell carcinoma
deep learning
convolutional neural network
author_facet Martin Halicek
James D. Dormer
James V. Little
Amy Y. Chen
Larry Myers
Baran D. Sumer
Baowei Fei
author_sort Martin Halicek
title Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning
title_short Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning
title_full Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning
title_fullStr Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning
title_full_unstemmed Hyperspectral Imaging of Head and Neck Squamous Cell Carcinoma for Cancer Margin Detection in Surgical Specimens from 102 Patients Using Deep Learning
title_sort hyperspectral imaging of head and neck squamous cell carcinoma for cancer margin detection in surgical specimens from 102 patients using deep learning
publisher MDPI AG
series Cancers
issn 2072-6694
publishDate 2019-09-01
description Surgical resection of head and neck (H and N) squamous cell carcinoma (SCC) may yield inadequate surgical cancer margins in 10 to 20% of cases. This study investigates the performance of label-free, reflectance-based hyperspectral imaging (HSI) and autofluorescence imaging for SCC detection at the cancer margin in excised tissue specimens from 102 patients and uses fluorescent dyes for comparison. Fresh surgical specimens (<i>n</i> = 293) were collected during H and N SCC resections (<i>n</i> = 102). The tissue specimens were imaged with reflectance-based HSI and autofluorescence imaging and afterwards with two fluorescent dyes for comparison. A histopathological ground truth was made. Deep learning tools were developed to detect SCC with new patient samples (inter-patient) and machine learning for intra-patient tissue samples. Area under the curve (AUC) of the receiver-operator characteristic was used as the main evaluation metric. Additionally, the performance was estimated in mm increments circumferentially from the tumor-normal margin. In intra-patient experiments, HSI classified conventional SCC with an AUC of 0.82 up to 3 mm from the cancer margin, which was more accurate than proflavin dye and autofluorescence (both <i>p</i> &lt; 0.05). Intra-patient autofluorescence imaging detected human papilloma virus positive (HPV+) SCC with an AUC of 0.99 at 3 mm and greater accuracy than proflavin dye (<i>p</i> &lt; 0.05). The inter-patient results showed that reflectance-based HSI and autofluorescence imaging outperformed proflavin dye and standard red, green, and blue (RGB) images (<i>p</i> &lt; 0.05). In new patients, HSI detected conventional SCC in the larynx, oropharynx, and nasal cavity with 0.85&#8722;0.95 AUC score, and autofluorescence imaging detected HPV+ SCC in tonsillar tissue with 0.91 AUC score. This study demonstrates that label-free, reflectance-based HSI and autofluorescence imaging methods can accurately detect the cancer margin in ex-vivo specimens within minutes. This non-ionizing optical imaging modality could aid surgeons and reduce inadequate surgical margins during SCC resections.
topic hyperspectral imaging
head and neck cancer
squamous cell carcinoma
deep learning
convolutional neural network
url https://www.mdpi.com/2072-6694/11/9/1367
work_keys_str_mv AT martinhalicek hyperspectralimagingofheadandnecksquamouscellcarcinomaforcancermargindetectioninsurgicalspecimensfrom102patientsusingdeeplearning
AT jamesddormer hyperspectralimagingofheadandnecksquamouscellcarcinomaforcancermargindetectioninsurgicalspecimensfrom102patientsusingdeeplearning
AT jamesvlittle hyperspectralimagingofheadandnecksquamouscellcarcinomaforcancermargindetectioninsurgicalspecimensfrom102patientsusingdeeplearning
AT amyychen hyperspectralimagingofheadandnecksquamouscellcarcinomaforcancermargindetectioninsurgicalspecimensfrom102patientsusingdeeplearning
AT larrymyers hyperspectralimagingofheadandnecksquamouscellcarcinomaforcancermargindetectioninsurgicalspecimensfrom102patientsusingdeeplearning
AT barandsumer hyperspectralimagingofheadandnecksquamouscellcarcinomaforcancermargindetectioninsurgicalspecimensfrom102patientsusingdeeplearning
AT baoweifei hyperspectralimagingofheadandnecksquamouscellcarcinomaforcancermargindetectioninsurgicalspecimensfrom102patientsusingdeeplearning
_version_ 1725112141867909120