New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm

Proportional–integral–derivative (PID) control is the most widely used control law in industrial processes. Although various new controllers continue to emerge, PID controllers are still in a dominant position due to their simple structure, easy implementation, and good robustn...

Full description

Bibliographic Details
Main Authors: Hongming Zhang, Wudhichai Assawinchaichote, Yan Shi
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9440392/
id doaj-0bfe6021de694bcea02225e94c5cca5f
record_format Article
spelling doaj-0bfe6021de694bcea02225e94c5cca5f2021-06-02T23:18:55ZengIEEEIEEE Access2169-35362021-01-019787997881110.1109/ACCESS.2021.30837059440392New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL AlgorithmHongming Zhang0https://orcid.org/0000-0003-3379-4858Wudhichai Assawinchaichote1https://orcid.org/0000-0003-1333-5646Yan Shi2Department of Electronic and Telecommunication Engineering, Faculty of Engineering, King Mongkut’s University of Technology Thonburi, Bangkok, ThailandDepartment of Electronic and Telecommunication Engineering, Faculty of Engineering, King Mongkut’s University of Technology Thonburi, Bangkok, ThailandGraduate School of Science and Technology, Tokai University, Kumamoto, JapanProportional–integral–derivative (PID) control is the most widely used control law in industrial processes. Although various new controllers continue to emerge, PID controllers are still in a dominant position due to their simple structure, easy implementation, and good robustness. In the design and application of PID controllers, one of the core issues is parameter tuning. Accurately and effectively selecting the best tuning parameters of the PID is the key to achieving an effective PID controller. Therefore, this paper proposes a novel modified monkey-multiagent DRL (MM-MADRL) algorithm and uses it to tune PID parameters to improve the stability and performance of automatic parameter optimization. The MM-MADRL algorithm is a new version of the basic monkey group algorithm (MA) and the multiagent reinforcement learning algorithm known as the multiagent deep deterministic policy gradient (MADDPG). This paper selects a typical nonlinear quadcopter system for simulation; its principle and data are given below. MM-MADRL, the genetic algorithm (GA), particle swarm optimization (PSO), the sparse search algorithm (SSA) and differential evolution (DE) are used to adjust the parameters. The simulation results show that the overall performance of the MM-MADRL algorithm is better than that of the other algorithms.https://ieeexplore.ieee.org/document/9440392/PID controllermonkey algorithm (MA)multiagent deep deterministic policy gradient (MADDPG)modified monkey–multiagent DRL (MM-MADRL) algorithmoptimization
collection DOAJ
language English
format Article
sources DOAJ
author Hongming Zhang
Wudhichai Assawinchaichote
Yan Shi
spellingShingle Hongming Zhang
Wudhichai Assawinchaichote
Yan Shi
New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm
IEEE Access
PID controller
monkey algorithm (MA)
multiagent deep deterministic policy gradient (MADDPG)
modified monkey–multiagent DRL (MM-MADRL) algorithm
optimization
author_facet Hongming Zhang
Wudhichai Assawinchaichote
Yan Shi
author_sort Hongming Zhang
title New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm
title_short New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm
title_full New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm
title_fullStr New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm
title_full_unstemmed New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm
title_sort new pid parameter autotuning for nonlinear systems based on a modified monkey–multiagent drl algorithm
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2021-01-01
description Proportional–integral–derivative (PID) control is the most widely used control law in industrial processes. Although various new controllers continue to emerge, PID controllers are still in a dominant position due to their simple structure, easy implementation, and good robustness. In the design and application of PID controllers, one of the core issues is parameter tuning. Accurately and effectively selecting the best tuning parameters of the PID is the key to achieving an effective PID controller. Therefore, this paper proposes a novel modified monkey-multiagent DRL (MM-MADRL) algorithm and uses it to tune PID parameters to improve the stability and performance of automatic parameter optimization. The MM-MADRL algorithm is a new version of the basic monkey group algorithm (MA) and the multiagent reinforcement learning algorithm known as the multiagent deep deterministic policy gradient (MADDPG). This paper selects a typical nonlinear quadcopter system for simulation; its principle and data are given below. MM-MADRL, the genetic algorithm (GA), particle swarm optimization (PSO), the sparse search algorithm (SSA) and differential evolution (DE) are used to adjust the parameters. The simulation results show that the overall performance of the MM-MADRL algorithm is better than that of the other algorithms.
topic PID controller
monkey algorithm (MA)
multiagent deep deterministic policy gradient (MADDPG)
modified monkey–multiagent DRL (MM-MADRL) algorithm
optimization
url https://ieeexplore.ieee.org/document/9440392/
work_keys_str_mv AT hongmingzhang newpidparameterautotuningfornonlinearsystemsbasedonamodifiedmonkeyx2013multiagentdrlalgorithm
AT wudhichaiassawinchaichote newpidparameterautotuningfornonlinearsystemsbasedonamodifiedmonkeyx2013multiagentdrlalgorithm
AT yanshi newpidparameterautotuningfornonlinearsystemsbasedonamodifiedmonkeyx2013multiagentdrlalgorithm
_version_ 1721400047215575040