HFMOEA: A hybrid framework for multi-objective feature selection

• Main Authors: Kundu, R. (Author), Mallipeddi, R. (Author)
• Format: Article
• Language: English
• Published: Oxford University Press 2022
• Subjects: Classification (of information); data management; data set; Deep learning; Digital storage; Economic and social effects; feature selection; Feature Selection; Features selection; filter ranking; Filter ranking; genetic algorithm; Genetic algorithms; Hybrid filters; Hybrid framework; hybrid optimization; Hybrid optimization; Learning algorithms; Multi-Objective Evolutionary Algorithm; Multiobjective optimization; Multi-objective optimization problem; multi-objective optimization problem (MOOP); Population initializations; ranking; Ranking methods
• Online Access: View Fulltext in Publisher

 In this data-driven era, where a large number of attributes are often publicly available, redundancy becomes a major problem, which leads to large storage and computational resource requirement. Feature selection is a method for reducing the dimensionality of the data by removing such redundant or misleading attributes. This leads to a selection of optimal feature subsets that can be used for further computation like the classification of data. Learning algorithms, when fitted on such optimal subsets of reduced dimensions, perform more efficiently and storing data also becomes easier. However, there exists a trade-off between the number of features selected and the accuracy obtained and the requirement for different tasks may vary. Thus, in this paper, a hybrid filter multi-objective evolutionary algorithm (HFMOEA) has been proposed based on the nondominated sorting genetic algorithm (NSGA-II) coupled with filter-based feature ranking methods for population initialization to obtain an optimal trade-off solution set to the problem. The two competing objectives for the algorithm are the minimization of the number of selected features and the maximization of the classification accuracy. The filter ranking methods used for population initialization help in faster convergence of the NSGA-II algorithm to the PF. The proposed HFMOEA method has been evaluated on 18 UCI datasets and 2 deep feature sets (features extracted from image datasets using deep learning models) to justify the viability of the approach with respect to the state-of-the-art. The relevant codes of the proposed approach are available at https://github.com/Rohit-Kundu/HFMOEA. © 2022 The Author(s) 2022. Published by Oxford University Press on behalf of the Society for Computational Design and Engineering.