New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm
Proportional–integral–derivative (PID) control is the most widely used control law in industrial processes. Although various new controllers continue to emerge, PID controllers are still in a dominant position due to their simple structure, easy implementation, and good robustn...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
IEEE
2021-01-01
|
Series: | IEEE Access |
Subjects: | |
Online Access: | https://ieeexplore.ieee.org/document/9440392/ |
id |
doaj-0bfe6021de694bcea02225e94c5cca5f |
---|---|
record_format |
Article |
spelling |
doaj-0bfe6021de694bcea02225e94c5cca5f2021-06-02T23:18:55ZengIEEEIEEE Access2169-35362021-01-019787997881110.1109/ACCESS.2021.30837059440392New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL AlgorithmHongming Zhang0https://orcid.org/0000-0003-3379-4858Wudhichai Assawinchaichote1https://orcid.org/0000-0003-1333-5646Yan Shi2Department of Electronic and Telecommunication Engineering, Faculty of Engineering, King Mongkut’s University of Technology Thonburi, Bangkok, ThailandDepartment of Electronic and Telecommunication Engineering, Faculty of Engineering, King Mongkut’s University of Technology Thonburi, Bangkok, ThailandGraduate School of Science and Technology, Tokai University, Kumamoto, JapanProportional–integral–derivative (PID) control is the most widely used control law in industrial processes. Although various new controllers continue to emerge, PID controllers are still in a dominant position due to their simple structure, easy implementation, and good robustness. In the design and application of PID controllers, one of the core issues is parameter tuning. Accurately and effectively selecting the best tuning parameters of the PID is the key to achieving an effective PID controller. Therefore, this paper proposes a novel modified monkey-multiagent DRL (MM-MADRL) algorithm and uses it to tune PID parameters to improve the stability and performance of automatic parameter optimization. The MM-MADRL algorithm is a new version of the basic monkey group algorithm (MA) and the multiagent reinforcement learning algorithm known as the multiagent deep deterministic policy gradient (MADDPG). This paper selects a typical nonlinear quadcopter system for simulation; its principle and data are given below. MM-MADRL, the genetic algorithm (GA), particle swarm optimization (PSO), the sparse search algorithm (SSA) and differential evolution (DE) are used to adjust the parameters. The simulation results show that the overall performance of the MM-MADRL algorithm is better than that of the other algorithms.https://ieeexplore.ieee.org/document/9440392/PID controllermonkey algorithm (MA)multiagent deep deterministic policy gradient (MADDPG)modified monkey–multiagent DRL (MM-MADRL) algorithmoptimization |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Hongming Zhang Wudhichai Assawinchaichote Yan Shi |
spellingShingle |
Hongming Zhang Wudhichai Assawinchaichote Yan Shi New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm IEEE Access PID controller monkey algorithm (MA) multiagent deep deterministic policy gradient (MADDPG) modified monkey–multiagent DRL (MM-MADRL) algorithm optimization |
author_facet |
Hongming Zhang Wudhichai Assawinchaichote Yan Shi |
author_sort |
Hongming Zhang |
title |
New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm |
title_short |
New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm |
title_full |
New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm |
title_fullStr |
New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm |
title_full_unstemmed |
New PID Parameter Autotuning for Nonlinear Systems Based on a Modified Monkey–Multiagent DRL Algorithm |
title_sort |
new pid parameter autotuning for nonlinear systems based on a modified monkey–multiagent drl algorithm |
publisher |
IEEE |
series |
IEEE Access |
issn |
2169-3536 |
publishDate |
2021-01-01 |
description |
Proportional–integral–derivative (PID) control is the most widely used control law in industrial processes. Although various new controllers continue to emerge, PID controllers are still in a dominant position due to their simple structure, easy implementation, and good robustness. In the design and application of PID controllers, one of the core issues is parameter tuning. Accurately and effectively selecting the best tuning parameters of the PID is the key to achieving an effective PID controller. Therefore, this paper proposes a novel modified monkey-multiagent DRL (MM-MADRL) algorithm and uses it to tune PID parameters to improve the stability and performance of automatic parameter optimization. The MM-MADRL algorithm is a new version of the basic monkey group algorithm (MA) and the multiagent reinforcement learning algorithm known as the multiagent deep deterministic policy gradient (MADDPG). This paper selects a typical nonlinear quadcopter system for simulation; its principle and data are given below. MM-MADRL, the genetic algorithm (GA), particle swarm optimization (PSO), the sparse search algorithm (SSA) and differential evolution (DE) are used to adjust the parameters. The simulation results show that the overall performance of the MM-MADRL algorithm is better than that of the other algorithms. |
topic |
PID controller monkey algorithm (MA) multiagent deep deterministic policy gradient (MADDPG) modified monkey–multiagent DRL (MM-MADRL) algorithm optimization |
url |
https://ieeexplore.ieee.org/document/9440392/ |
work_keys_str_mv |
AT hongmingzhang newpidparameterautotuningfornonlinearsystemsbasedonamodifiedmonkeyx2013multiagentdrlalgorithm AT wudhichaiassawinchaichote newpidparameterautotuningfornonlinearsystemsbasedonamodifiedmonkeyx2013multiagentdrlalgorithm AT yanshi newpidparameterautotuningfornonlinearsystemsbasedonamodifiedmonkeyx2013multiagentdrlalgorithm |
_version_ |
1721400047215575040 |