Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading

Radiomics-based researches have shown predictive abilities with machine-learning approaches. However, it is still unknown whether different radiomics strategies affect the prediction performance. The aim of this study was to compare the prediction performance of frequently utilized radiomics feature...

Full description

Bibliographic Details
Main Authors: Pan Sun, Defeng Wang, Vincent Ct Mok, Lin Shi
Format: Article
Language:English
Published: IEEE 2019-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8763934/
id doaj-747a41cd7bfc440c9d75d71a4a1b2ae6
record_format Article
spelling doaj-747a41cd7bfc440c9d75d71a4a1b2ae62021-04-05T17:17:31ZengIEEEIEEE Access2169-35362019-01-01710201010202010.1109/ACCESS.2019.29289758763934Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma GradingPan Sun0Defeng Wang1Vincent Ct Mok2Lin Shi3https://orcid.org/0000-0003-2318-4669Department of Medicine and Therapeutics, The Chinese University of Hong Kong, Hong KongSchool of Instrumentation Science and Opto-electronics Engineering, Beihang University, Beijing, ChinaDepartment of Medicine and Therapeutics, The Chinese University of Hong Kong, Hong KongDepartment of Imaging and Interventional Radiology, The Chinese University of Hong Kong, Hong KongRadiomics-based researches have shown predictive abilities with machine-learning approaches. However, it is still unknown whether different radiomics strategies affect the prediction performance. The aim of this study was to compare the prediction performance of frequently utilized radiomics feature selection and classification methods in glioma grading. Quantitative radiomics features were extracted from tumor regions in 210 Glioblastoma (GBM) and 75 low-grade glioma (LGG) MRI subjects. Then, the diagnostic performance of sixteen feature selection and fifteen classification methods were evaluated by using two different test modes: ten-fold cross-validation and percentage split. Balanced accuracy and area under the curve (AUC) of the receiver operating characteristic were used to evaluate prediction performance. In addition, the roles of the number of selected features, feature type, MRI modality, and tumor sub-region were compared to optimize the radiomics-based prediction. The results indicated that the combination of feature selection method L<sup>1</sup>-based linear support vector machine (L<sup>1</sup>-SVM) and classifier multi-layer perceptron (MLPC) achieved the best performance in the differentiation of GBM and LGG in both ten-fold cross validation (balanced accuracy:0.944, AUC:0.986) and percentage split (balanced accuracy:0.953, AUC:0.981). For radiomics feature extraction, the enhancing tumor region (ET) combined with necrotic and non-enhancing tumor (NCR/NET) regions in T1 post-contrast (T1-Gd) modality provided more considerable tumor-related phenotypes than other combinations of tumor region and MRI modality. Our comparative investigation indicated that both feature selection methods and machine learning classifiers affected the predictive performance in glioma grading. Also, the cross-combination strategy for comparison of radiomics feature selection and classification methods provided a way of searching optimal machine learning model for future radiomics-based prediction.https://ieeexplore.ieee.org/document/8763934/Glioma grademachine learningfeature classificationfeature selectionradiomics
collection DOAJ
language English
format Article
sources DOAJ
author Pan Sun
Defeng Wang
Vincent Ct Mok
Lin Shi
spellingShingle Pan Sun
Defeng Wang
Vincent Ct Mok
Lin Shi
Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading
IEEE Access
Glioma grade
machine learning
feature classification
feature selection
radiomics
author_facet Pan Sun
Defeng Wang
Vincent Ct Mok
Lin Shi
author_sort Pan Sun
title Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading
title_short Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading
title_full Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading
title_fullStr Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading
title_full_unstemmed Comparison of Feature Selection Methods and Machine Learning Classifiers for Radiomics Analysis in Glioma Grading
title_sort comparison of feature selection methods and machine learning classifiers for radiomics analysis in glioma grading
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2019-01-01
description Radiomics-based researches have shown predictive abilities with machine-learning approaches. However, it is still unknown whether different radiomics strategies affect the prediction performance. The aim of this study was to compare the prediction performance of frequently utilized radiomics feature selection and classification methods in glioma grading. Quantitative radiomics features were extracted from tumor regions in 210 Glioblastoma (GBM) and 75 low-grade glioma (LGG) MRI subjects. Then, the diagnostic performance of sixteen feature selection and fifteen classification methods were evaluated by using two different test modes: ten-fold cross-validation and percentage split. Balanced accuracy and area under the curve (AUC) of the receiver operating characteristic were used to evaluate prediction performance. In addition, the roles of the number of selected features, feature type, MRI modality, and tumor sub-region were compared to optimize the radiomics-based prediction. The results indicated that the combination of feature selection method L<sup>1</sup>-based linear support vector machine (L<sup>1</sup>-SVM) and classifier multi-layer perceptron (MLPC) achieved the best performance in the differentiation of GBM and LGG in both ten-fold cross validation (balanced accuracy:0.944, AUC:0.986) and percentage split (balanced accuracy:0.953, AUC:0.981). For radiomics feature extraction, the enhancing tumor region (ET) combined with necrotic and non-enhancing tumor (NCR/NET) regions in T1 post-contrast (T1-Gd) modality provided more considerable tumor-related phenotypes than other combinations of tumor region and MRI modality. Our comparative investigation indicated that both feature selection methods and machine learning classifiers affected the predictive performance in glioma grading. Also, the cross-combination strategy for comparison of radiomics feature selection and classification methods provided a way of searching optimal machine learning model for future radiomics-based prediction.
topic Glioma grade
machine learning
feature classification
feature selection
radiomics
url https://ieeexplore.ieee.org/document/8763934/
work_keys_str_mv AT pansun comparisonoffeatureselectionmethodsandmachinelearningclassifiersforradiomicsanalysisingliomagrading
AT defengwang comparisonoffeatureselectionmethodsandmachinelearningclassifiersforradiomicsanalysisingliomagrading
AT vincentctmok comparisonoffeatureselectionmethodsandmachinelearningclassifiersforradiomicsanalysisingliomagrading
AT linshi comparisonoffeatureselectionmethodsandmachinelearningclassifiersforradiomicsanalysisingliomagrading
_version_ 1721539920505339904