Particle Swarm Optimization With Probability Sequence for Global Optimization
Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to...
Main Authors: | , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2020-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9117125/ |
id |
doaj-2cfee87ccd21488682b02f2f6804ca0d |
---|---|
record_format |
Article |
spelling |
doaj-2cfee87ccd21488682b02f2f6804ca0d2021-03-30T01:47:54ZengIEEEIEEE Access2169-35362020-01-01811053511054910.1109/ACCESS.2020.30027259117125Particle Swarm Optimization With Probability Sequence for Global OptimizationHafiz Tayyab Rauf0Umar Shoaib1Muhammad Ikramullah Lali2https://orcid.org/0000-0003-2208-5853Majed Alhaisoni3Muhammad Naeem Irfan4Muhammad Attique Khan5Department of Computer Science, University of Gujrat, Gujrat, PakistanDepartment of Computer Science, University of Gujrat, Gujrat, PakistanDepartment of Computer Science, University of Education, Lahore, PakistanCollege of Computer Science and Engineering, University of Ha’il, Ha’il, Saudi ArabiaFEAS, Chang School, Ryerson University, Toronto, ON, CanadaDepartment of Computer Science, HITEC University, Taxila, PakistanParticle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to enhance the diversity of swarm and convergence speed. Population initialization method based on uniform distribution is normally used when there is no preceding knowledge available regarding the candidate solution. In this paper, a new approach to initialize population is proposed using probability sequence Weibull marked as (WI-PSO) that applies the probability distribution to generate numbers at random locations for swarm initialization. The proposed method (WI-PSO) is tested on sixteen well-known uni-modal and multi-modal benchmark test functions broadly adopted by the research community and its encouraging performance is investigated and compared with the Exponential distribution based PSO (E-PSO), Beta distribution based PSO (BT-PSO), Gamma distribution based PSO (GA-PSO) and Log-normal distribution based PSO (LN-PSO). Artificial Neural Networks (ANNs) have become the most powerful tool for classification of complex benchmark problems. We have experimented the proposed method (WI-PSO) for weight optimization of a feed-forward neural network to ensure its purity and have compared with conventional back-propagation algorithm (BPA), E-PSO, BT-PSO, GA-PSO and LN-PSO. Due to flexible behaviour in the degree of freedom, the experimental results infer the perfection and dominance of the Weibull based population initialization. The result exhibits the anticipation of influence exerted by the proposed technique on all sixteen objective functions and eight real-world benchmark data sets.https://ieeexplore.ieee.org/document/9117125/Particle swarm optimizationWeibull distributionneural networks |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hafiz Tayyab Rauf Umar Shoaib Muhammad Ikramullah Lali Majed Alhaisoni Muhammad Naeem Irfan Muhammad Attique Khan |
spellingShingle |
Hafiz Tayyab Rauf Umar Shoaib Muhammad Ikramullah Lali Majed Alhaisoni Muhammad Naeem Irfan Muhammad Attique Khan Particle Swarm Optimization With Probability Sequence for Global Optimization IEEE Access Particle swarm optimization Weibull distribution neural networks |
author_facet |
Hafiz Tayyab Rauf Umar Shoaib Muhammad Ikramullah Lali Majed Alhaisoni Muhammad Naeem Irfan Muhammad Attique Khan |
author_sort |
Hafiz Tayyab Rauf |
title |
Particle Swarm Optimization With Probability Sequence for Global Optimization |
title_short |
Particle Swarm Optimization With Probability Sequence for Global Optimization |
title_full |
Particle Swarm Optimization With Probability Sequence for Global Optimization |
title_fullStr |
Particle Swarm Optimization With Probability Sequence for Global Optimization |
title_full_unstemmed |
Particle Swarm Optimization With Probability Sequence for Global Optimization |
title_sort |
particle swarm optimization with probability sequence for global optimization |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2020-01-01 |
description |
Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to enhance the diversity of swarm and convergence speed. Population initialization method based on uniform distribution is normally used when there is no preceding knowledge available regarding the candidate solution. In this paper, a new approach to initialize population is proposed using probability sequence Weibull marked as (WI-PSO) that applies the probability distribution to generate numbers at random locations for swarm initialization. The proposed method (WI-PSO) is tested on sixteen well-known uni-modal and multi-modal benchmark test functions broadly adopted by the research community and its encouraging performance is investigated and compared with the Exponential distribution based PSO (E-PSO), Beta distribution based PSO (BT-PSO), Gamma distribution based PSO (GA-PSO) and Log-normal distribution based PSO (LN-PSO). Artificial Neural Networks (ANNs) have become the most powerful tool for classification of complex benchmark problems. We have experimented the proposed method (WI-PSO) for weight optimization of a feed-forward neural network to ensure its purity and have compared with conventional back-propagation algorithm (BPA), E-PSO, BT-PSO, GA-PSO and LN-PSO. Due to flexible behaviour in the degree of freedom, the experimental results infer the perfection and dominance of the Weibull based population initialization. The result exhibits the anticipation of influence exerted by the proposed technique on all sixteen objective functions and eight real-world benchmark data sets. |
topic |
Particle swarm optimization Weibull distribution neural networks |
url |
https://ieeexplore.ieee.org/document/9117125/ |
work_keys_str_mv |
AT hafiztayyabrauf particleswarmoptimizationwithprobabilitysequenceforglobaloptimization AT umarshoaib particleswarmoptimizationwithprobabilitysequenceforglobaloptimization AT muhammadikramullahlali particleswarmoptimizationwithprobabilitysequenceforglobaloptimization AT majedalhaisoni particleswarmoptimizationwithprobabilitysequenceforglobaloptimization AT muhammadnaeemirfan particleswarmoptimizationwithprobabilitysequenceforglobaloptimization AT muhammadattiquekhan particleswarmoptimizationwithprobabilitysequenceforglobaloptimization |
_version_ |
1724186417206132736 |