Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning

Abstract In this paper, the optimal demand response strategy of a commercial building‐based virtual power plant with real‐world implementation in heavily urbanised area is studied. Instead of modelling the decision‐making process as an optimisation problem, a reinforcement learning method is used to...

Full description

Bibliographic Details
Main Authors: Tao Chen, Qiushi Cui, Ciwei Gao, Qinran Hu, Kexing Lai, Jianlin Yang, Ran Lyu, Hao Zhang, Jinyuan Zhang
Format: Article
Language:English
Published: Wiley 2021-08-01
Series:IET Generation, Transmission & Distribution
Online Access:https://doi.org/10.1049/gtd2.12179
id doaj-e2bd4b76036c49cbab4a31797f144dfa
record_format Article
spelling doaj-e2bd4b76036c49cbab4a31797f144dfa2021-07-14T13:26:05ZengWileyIET Generation, Transmission & Distribution1751-86871751-86952021-08-0115162309231810.1049/gtd2.12179Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learningTao Chen0Qiushi Cui1Ciwei Gao2Qinran Hu3Kexing Lai4Jianlin Yang5Ran Lyu6Hao Zhang7Jinyuan Zhang8School of Electrical Engineering Southeast University Nanjing ChinaDepartment of Electrical and Computer Engineering Arizona State University Tempe Arizona USASchool of Electrical Engineering Southeast University Nanjing ChinaSchool of Electrical Engineering Southeast University Nanjing ChinaOptimization Division Hitachi ABB Power Grids San Jose California USAWind Power Industry Innovation Center State Power Investment Corporation Limited's (SPIC) Shanghai ChinaEconomic Technology Research Institute State Grid Corporation of China‐Shanghai Company Shanghai ChinaDepartment of Technology and Management Tengtian Energy Saving Technology Corporation Limited's Shanghai ChinaAdministration Office Shanghai Huangpu District Development and Reform Commission Shanghai ChinaAbstract In this paper, the optimal demand response strategy of a commercial building‐based virtual power plant with real‐world implementation in heavily urbanised area is studied. Instead of modelling the decision‐making process as an optimisation problem, a reinforcement learning method is used to seek the optimal strategy, which could update its performance with minimal manpower manipulation. Specifically, the data collection from several commercial buildings, including hotel, shopping mall and office, in Huangpu district, Shanghai city is analysed to deploy the demand response program. Compared with the conventional demand response strategy based on optimisation, the learnt strategy does not rely on the forecasting information as input and could adapt to the changing demand response incentive automatically. It may not produce the best result every time, but can guarantee the benefit in a non‐deterministic way in long‐term operation. The real‐world deployment of the Huangpu virtual power plant involving hardware and software platform is also introduced, as well as its future development projection.https://doi.org/10.1049/gtd2.12179
collection DOAJ
language English
format Article
sources DOAJ
author Tao Chen
Qiushi Cui
Ciwei Gao
Qinran Hu
Kexing Lai
Jianlin Yang
Ran Lyu
Hao Zhang
Jinyuan Zhang
spellingShingle Tao Chen
Qiushi Cui
Ciwei Gao
Qinran Hu
Kexing Lai
Jianlin Yang
Ran Lyu
Hao Zhang
Jinyuan Zhang
Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning
IET Generation, Transmission & Distribution
author_facet Tao Chen
Qiushi Cui
Ciwei Gao
Qinran Hu
Kexing Lai
Jianlin Yang
Ran Lyu
Hao Zhang
Jinyuan Zhang
author_sort Tao Chen
title Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning
title_short Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning
title_full Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning
title_fullStr Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning
title_full_unstemmed Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning
title_sort optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning
publisher Wiley
series IET Generation, Transmission & Distribution
issn 1751-8687
1751-8695
publishDate 2021-08-01
description Abstract In this paper, the optimal demand response strategy of a commercial building‐based virtual power plant with real‐world implementation in heavily urbanised area is studied. Instead of modelling the decision‐making process as an optimisation problem, a reinforcement learning method is used to seek the optimal strategy, which could update its performance with minimal manpower manipulation. Specifically, the data collection from several commercial buildings, including hotel, shopping mall and office, in Huangpu district, Shanghai city is analysed to deploy the demand response program. Compared with the conventional demand response strategy based on optimisation, the learnt strategy does not rely on the forecasting information as input and could adapt to the changing demand response incentive automatically. It may not produce the best result every time, but can guarantee the benefit in a non‐deterministic way in long‐term operation. The real‐world deployment of the Huangpu virtual power plant involving hardware and software platform is also introduced, as well as its future development projection.
url https://doi.org/10.1049/gtd2.12179
work_keys_str_mv AT taochen optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
AT qiushicui optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
AT ciweigao optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
AT qinranhu optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
AT kexinglai optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
AT jianlinyang optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
AT ranlyu optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
AT haozhang optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
AT jinyuanzhang optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning
_version_ 1721302753784889344