Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models

In this research, we propose two Particle Swarm Optimisation (PSO) variants to undertake feature selection tasks. The aim is to overcome two major shortcomings of the original PSO model, i.e., premature convergence and weak exploitation around the near optimal solutions. The first proposed PSO varia...

Full description

Bibliographic Details
Main Authors: Hailun Xie, Li Zhang, Chee Peng Lim, Yonghong Yu, Han Liu
Format: Article
Language:English
Published: MDPI AG 2021-03-01
Series:Sensors
Subjects:
Online Access:https://www.mdpi.com/1424-8220/21/5/1816
id doaj-1e75ba2aea56410f9aceb368a8a1a114
record_format Article
spelling doaj-1e75ba2aea56410f9aceb368a8a1a1142021-03-06T00:06:00ZengMDPI AGSensors1424-82202021-03-01211816181610.3390/s21051816Feature Selection Using Enhanced Particle Swarm Optimisation for Classification ModelsHailun Xie0Li Zhang1Chee Peng Lim2Yonghong Yu3Han Liu4Computational Intelligence Research Group, Department of Computer and Information Sciences, Faculty of Engineering and Environment, University of Northumbria, Newcastle upon Tyne NE1 8ST, UKComputational Intelligence Research Group, Department of Computer and Information Sciences, Faculty of Engineering and Environment, University of Northumbria, Newcastle upon Tyne NE1 8ST, UKInstitute for Intelligent Systems Research and Innovation, Deakin University, Waurn Ponds, VIC 3216, AustraliaCollege of Tongda, Nanjing University of Posts and Telecommunications, Nanjing 210049, ChinaCollege of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, ChinaIn this research, we propose two Particle Swarm Optimisation (PSO) variants to undertake feature selection tasks. The aim is to overcome two major shortcomings of the original PSO model, i.e., premature convergence and weak exploitation around the near optimal solutions. The first proposed PSO variant incorporates four key operations, including a modified PSO operation with rectified personal and global best signals, spiral search based local exploitation, Gaussian distribution-based swarm leader enhancement, and mirroring and mutation operations for worst solution improvement. The second proposed PSO model enhances the first one through four new strategies, i.e., an adaptive exemplar breeding mechanism incorporating multiple optimal signals, nonlinear function oriented search coefficients, exponential and scattering schemes for swarm leader, and worst solution enhancement, respectively. In comparison with a set of 15 classical and advanced search methods, the proposed models illustrate statistical superiority for discriminative feature selection for a total of 13 data sets.https://www.mdpi.com/1424-8220/21/5/1816feature selectionevolutionary algorithmparticle swarm optimisationclassification
collection DOAJ
language English
format Article
sources DOAJ
author Hailun Xie
Li Zhang
Chee Peng Lim
Yonghong Yu
Han Liu
spellingShingle Hailun Xie
Li Zhang
Chee Peng Lim
Yonghong Yu
Han Liu
Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models
Sensors
feature selection
evolutionary algorithm
particle swarm optimisation
classification
author_facet Hailun Xie
Li Zhang
Chee Peng Lim
Yonghong Yu
Han Liu
author_sort Hailun Xie
title Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models
title_short Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models
title_full Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models
title_fullStr Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models
title_full_unstemmed Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models
title_sort feature selection using enhanced particle swarm optimisation for classification models
publisher MDPI AG
series Sensors
issn 1424-8220
publishDate 2021-03-01
description In this research, we propose two Particle Swarm Optimisation (PSO) variants to undertake feature selection tasks. The aim is to overcome two major shortcomings of the original PSO model, i.e., premature convergence and weak exploitation around the near optimal solutions. The first proposed PSO variant incorporates four key operations, including a modified PSO operation with rectified personal and global best signals, spiral search based local exploitation, Gaussian distribution-based swarm leader enhancement, and mirroring and mutation operations for worst solution improvement. The second proposed PSO model enhances the first one through four new strategies, i.e., an adaptive exemplar breeding mechanism incorporating multiple optimal signals, nonlinear function oriented search coefficients, exponential and scattering schemes for swarm leader, and worst solution enhancement, respectively. In comparison with a set of 15 classical and advanced search methods, the proposed models illustrate statistical superiority for discriminative feature selection for a total of 13 data sets.
topic feature selection
evolutionary algorithm
particle swarm optimisation
classification
url https://www.mdpi.com/1424-8220/21/5/1816
work_keys_str_mv AT hailunxie featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels
AT lizhang featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels
AT cheepenglim featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels
AT yonghongyu featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels
AT hanliu featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels
_version_ 1724229931922096128