Particle Swarm Optimization With Probability Sequence for Global Optimization

Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to...

Full description

Bibliographic Details
Main Authors: Hafiz Tayyab Rauf, Umar Shoaib, Muhammad Ikramullah Lali, Majed Alhaisoni, Muhammad Naeem Irfan, Muhammad Attique Khan
Format: Article
Language:English
Published: IEEE 2020-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9117125/
id doaj-2cfee87ccd21488682b02f2f6804ca0d
record_format Article
spelling doaj-2cfee87ccd21488682b02f2f6804ca0d2021-03-30T01:47:54ZengIEEEIEEE Access2169-35362020-01-01811053511054910.1109/ACCESS.2020.30027259117125Particle Swarm Optimization With Probability Sequence for Global OptimizationHafiz Tayyab Rauf0Umar Shoaib1Muhammad Ikramullah Lali2https://orcid.org/0000-0003-2208-5853Majed Alhaisoni3Muhammad Naeem Irfan4Muhammad Attique Khan5Department of Computer Science, University of Gujrat, Gujrat, PakistanDepartment of Computer Science, University of Gujrat, Gujrat, PakistanDepartment of Computer Science, University of Education, Lahore, PakistanCollege of Computer Science and Engineering, University of Ha’il, Ha’il, Saudi ArabiaFEAS, Chang School, Ryerson University, Toronto, ON, CanadaDepartment of Computer Science, HITEC University, Taxila, PakistanParticle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to enhance the diversity of swarm and convergence speed. Population initialization method based on uniform distribution is normally used when there is no preceding knowledge available regarding the candidate solution. In this paper, a new approach to initialize population is proposed using probability sequence Weibull marked as (WI-PSO) that applies the probability distribution to generate numbers at random locations for swarm initialization. The proposed method (WI-PSO) is tested on sixteen well-known uni-modal and multi-modal benchmark test functions broadly adopted by the research community and its encouraging performance is investigated and compared with the Exponential distribution based PSO (E-PSO), Beta distribution based PSO (BT-PSO), Gamma distribution based PSO (GA-PSO) and Log-normal distribution based PSO (LN-PSO). Artificial Neural Networks (ANNs) have become the most powerful tool for classification of complex benchmark problems. We have experimented the proposed method (WI-PSO) for weight optimization of a feed-forward neural network to ensure its purity and have compared with conventional back-propagation algorithm (BPA), E-PSO, BT-PSO, GA-PSO and LN-PSO. Due to flexible behaviour in the degree of freedom, the experimental results infer the perfection and dominance of the Weibull based population initialization. The result exhibits the anticipation of influence exerted by the proposed technique on all sixteen objective functions and eight real-world benchmark data sets.https://ieeexplore.ieee.org/document/9117125/Particle swarm optimizationWeibull distributionneural networks
collection DOAJ
language English
format Article
sources DOAJ
author Hafiz Tayyab Rauf
Umar Shoaib
Muhammad Ikramullah Lali
Majed Alhaisoni
Muhammad Naeem Irfan
Muhammad Attique Khan
spellingShingle Hafiz Tayyab Rauf
Umar Shoaib
Muhammad Ikramullah Lali
Majed Alhaisoni
Muhammad Naeem Irfan
Muhammad Attique Khan
Particle Swarm Optimization With Probability Sequence for Global Optimization
IEEE Access
Particle swarm optimization
Weibull distribution
neural networks
author_facet Hafiz Tayyab Rauf
Umar Shoaib
Muhammad Ikramullah Lali
Majed Alhaisoni
Muhammad Naeem Irfan
Muhammad Attique Khan
author_sort Hafiz Tayyab Rauf
title Particle Swarm Optimization With Probability Sequence for Global Optimization
title_short Particle Swarm Optimization With Probability Sequence for Global Optimization
title_full Particle Swarm Optimization With Probability Sequence for Global Optimization
title_fullStr Particle Swarm Optimization With Probability Sequence for Global Optimization
title_full_unstemmed Particle Swarm Optimization With Probability Sequence for Global Optimization
title_sort particle swarm optimization with probability sequence for global optimization
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2020-01-01
description Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to enhance the diversity of swarm and convergence speed. Population initialization method based on uniform distribution is normally used when there is no preceding knowledge available regarding the candidate solution. In this paper, a new approach to initialize population is proposed using probability sequence Weibull marked as (WI-PSO) that applies the probability distribution to generate numbers at random locations for swarm initialization. The proposed method (WI-PSO) is tested on sixteen well-known uni-modal and multi-modal benchmark test functions broadly adopted by the research community and its encouraging performance is investigated and compared with the Exponential distribution based PSO (E-PSO), Beta distribution based PSO (BT-PSO), Gamma distribution based PSO (GA-PSO) and Log-normal distribution based PSO (LN-PSO). Artificial Neural Networks (ANNs) have become the most powerful tool for classification of complex benchmark problems. We have experimented the proposed method (WI-PSO) for weight optimization of a feed-forward neural network to ensure its purity and have compared with conventional back-propagation algorithm (BPA), E-PSO, BT-PSO, GA-PSO and LN-PSO. Due to flexible behaviour in the degree of freedom, the experimental results infer the perfection and dominance of the Weibull based population initialization. The result exhibits the anticipation of influence exerted by the proposed technique on all sixteen objective functions and eight real-world benchmark data sets.
topic Particle swarm optimization
Weibull distribution
neural networks
url https://ieeexplore.ieee.org/document/9117125/
work_keys_str_mv AT hafiztayyabrauf particleswarmoptimizationwithprobabilitysequenceforglobaloptimization
AT umarshoaib particleswarmoptimizationwithprobabilitysequenceforglobaloptimization
AT muhammadikramullahlali particleswarmoptimizationwithprobabilitysequenceforglobaloptimization
AT majedalhaisoni particleswarmoptimizationwithprobabilitysequenceforglobaloptimization
AT muhammadnaeemirfan particleswarmoptimizationwithprobabilitysequenceforglobaloptimization
AT muhammadattiquekhan particleswarmoptimizationwithprobabilitysequenceforglobaloptimization
_version_ 1724186417206132736