Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models
In this research, we propose two Particle Swarm Optimisation (PSO) variants to undertake feature selection tasks. The aim is to overcome two major shortcomings of the original PSO model, i.e., premature convergence and weak exploitation around the near optimal solutions. The first proposed PSO varia...
Main Authors: | , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2021-03-01
|
Series: | Sensors |
Subjects: | |
Online Access: | https://www.mdpi.com/1424-8220/21/5/1816 |
id |
doaj-1e75ba2aea56410f9aceb368a8a1a114 |
---|---|
record_format |
Article |
spelling |
doaj-1e75ba2aea56410f9aceb368a8a1a1142021-03-06T00:06:00ZengMDPI AGSensors1424-82202021-03-01211816181610.3390/s21051816Feature Selection Using Enhanced Particle Swarm Optimisation for Classification ModelsHailun Xie0Li Zhang1Chee Peng Lim2Yonghong Yu3Han Liu4Computational Intelligence Research Group, Department of Computer and Information Sciences, Faculty of Engineering and Environment, University of Northumbria, Newcastle upon Tyne NE1 8ST, UKComputational Intelligence Research Group, Department of Computer and Information Sciences, Faculty of Engineering and Environment, University of Northumbria, Newcastle upon Tyne NE1 8ST, UKInstitute for Intelligent Systems Research and Innovation, Deakin University, Waurn Ponds, VIC 3216, AustraliaCollege of Tongda, Nanjing University of Posts and Telecommunications, Nanjing 210049, ChinaCollege of Computer Science and Software Engineering, Shenzhen University, Shenzhen 518060, ChinaIn this research, we propose two Particle Swarm Optimisation (PSO) variants to undertake feature selection tasks. The aim is to overcome two major shortcomings of the original PSO model, i.e., premature convergence and weak exploitation around the near optimal solutions. The first proposed PSO variant incorporates four key operations, including a modified PSO operation with rectified personal and global best signals, spiral search based local exploitation, Gaussian distribution-based swarm leader enhancement, and mirroring and mutation operations for worst solution improvement. The second proposed PSO model enhances the first one through four new strategies, i.e., an adaptive exemplar breeding mechanism incorporating multiple optimal signals, nonlinear function oriented search coefficients, exponential and scattering schemes for swarm leader, and worst solution enhancement, respectively. In comparison with a set of 15 classical and advanced search methods, the proposed models illustrate statistical superiority for discriminative feature selection for a total of 13 data sets.https://www.mdpi.com/1424-8220/21/5/1816feature selectionevolutionary algorithmparticle swarm optimisationclassification |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hailun Xie Li Zhang Chee Peng Lim Yonghong Yu Han Liu |
spellingShingle |
Hailun Xie Li Zhang Chee Peng Lim Yonghong Yu Han Liu Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models Sensors feature selection evolutionary algorithm particle swarm optimisation classification |
author_facet |
Hailun Xie Li Zhang Chee Peng Lim Yonghong Yu Han Liu |
author_sort |
Hailun Xie |
title |
Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models |
title_short |
Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models |
title_full |
Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models |
title_fullStr |
Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models |
title_full_unstemmed |
Feature Selection Using Enhanced Particle Swarm Optimisation for Classification Models |
title_sort |
feature selection using enhanced particle swarm optimisation for classification models |
publisher |
MDPI AG |
series |
Sensors |
issn |
1424-8220 |
publishDate |
2021-03-01 |
description |
In this research, we propose two Particle Swarm Optimisation (PSO) variants to undertake feature selection tasks. The aim is to overcome two major shortcomings of the original PSO model, i.e., premature convergence and weak exploitation around the near optimal solutions. The first proposed PSO variant incorporates four key operations, including a modified PSO operation with rectified personal and global best signals, spiral search based local exploitation, Gaussian distribution-based swarm leader enhancement, and mirroring and mutation operations for worst solution improvement. The second proposed PSO model enhances the first one through four new strategies, i.e., an adaptive exemplar breeding mechanism incorporating multiple optimal signals, nonlinear function oriented search coefficients, exponential and scattering schemes for swarm leader, and worst solution enhancement, respectively. In comparison with a set of 15 classical and advanced search methods, the proposed models illustrate statistical superiority for discriminative feature selection for a total of 13 data sets. |
topic |
feature selection evolutionary algorithm particle swarm optimisation classification |
url |
https://www.mdpi.com/1424-8220/21/5/1816 |
work_keys_str_mv |
AT hailunxie featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels AT lizhang featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels AT cheepenglim featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels AT yonghongyu featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels AT hanliu featureselectionusingenhancedparticleswarmoptimisationforclassificationmodels |
_version_ |
1724229931922096128 |