Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning
Abstract In this paper, the optimal demand response strategy of a commercial building‐based virtual power plant with real‐world implementation in heavily urbanised area is studied. Instead of modelling the decision‐making process as an optimisation problem, a reinforcement learning method is used to...
Main Authors: | , , , , , , , , |
---|---|
Format: | Article |
Language: | English |
Published: |
Wiley
2021-08-01
|
Series: | IET Generation, Transmission & Distribution |
Online Access: | https://doi.org/10.1049/gtd2.12179 |
id |
doaj-e2bd4b76036c49cbab4a31797f144dfa |
---|---|
record_format |
Article |
spelling |
doaj-e2bd4b76036c49cbab4a31797f144dfa2021-07-14T13:26:05ZengWileyIET Generation, Transmission & Distribution1751-86871751-86952021-08-0115162309231810.1049/gtd2.12179Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learningTao Chen0Qiushi Cui1Ciwei Gao2Qinran Hu3Kexing Lai4Jianlin Yang5Ran Lyu6Hao Zhang7Jinyuan Zhang8School of Electrical Engineering Southeast University Nanjing ChinaDepartment of Electrical and Computer Engineering Arizona State University Tempe Arizona USASchool of Electrical Engineering Southeast University Nanjing ChinaSchool of Electrical Engineering Southeast University Nanjing ChinaOptimization Division Hitachi ABB Power Grids San Jose California USAWind Power Industry Innovation Center State Power Investment Corporation Limited's (SPIC) Shanghai ChinaEconomic Technology Research Institute State Grid Corporation of China‐Shanghai Company Shanghai ChinaDepartment of Technology and Management Tengtian Energy Saving Technology Corporation Limited's Shanghai ChinaAdministration Office Shanghai Huangpu District Development and Reform Commission Shanghai ChinaAbstract In this paper, the optimal demand response strategy of a commercial building‐based virtual power plant with real‐world implementation in heavily urbanised area is studied. Instead of modelling the decision‐making process as an optimisation problem, a reinforcement learning method is used to seek the optimal strategy, which could update its performance with minimal manpower manipulation. Specifically, the data collection from several commercial buildings, including hotel, shopping mall and office, in Huangpu district, Shanghai city is analysed to deploy the demand response program. Compared with the conventional demand response strategy based on optimisation, the learnt strategy does not rely on the forecasting information as input and could adapt to the changing demand response incentive automatically. It may not produce the best result every time, but can guarantee the benefit in a non‐deterministic way in long‐term operation. The real‐world deployment of the Huangpu virtual power plant involving hardware and software platform is also introduced, as well as its future development projection.https://doi.org/10.1049/gtd2.12179 |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Tao Chen Qiushi Cui Ciwei Gao Qinran Hu Kexing Lai Jianlin Yang Ran Lyu Hao Zhang Jinyuan Zhang |
spellingShingle |
Tao Chen Qiushi Cui Ciwei Gao Qinran Hu Kexing Lai Jianlin Yang Ran Lyu Hao Zhang Jinyuan Zhang Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning IET Generation, Transmission & Distribution |
author_facet |
Tao Chen Qiushi Cui Ciwei Gao Qinran Hu Kexing Lai Jianlin Yang Ran Lyu Hao Zhang Jinyuan Zhang |
author_sort |
Tao Chen |
title |
Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning |
title_short |
Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning |
title_full |
Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning |
title_fullStr |
Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning |
title_full_unstemmed |
Optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning |
title_sort |
optimal demand response strategy of commercial building‐based virtual power plant using reinforcement learning |
publisher |
Wiley |
series |
IET Generation, Transmission & Distribution |
issn |
1751-8687 1751-8695 |
publishDate |
2021-08-01 |
description |
Abstract In this paper, the optimal demand response strategy of a commercial building‐based virtual power plant with real‐world implementation in heavily urbanised area is studied. Instead of modelling the decision‐making process as an optimisation problem, a reinforcement learning method is used to seek the optimal strategy, which could update its performance with minimal manpower manipulation. Specifically, the data collection from several commercial buildings, including hotel, shopping mall and office, in Huangpu district, Shanghai city is analysed to deploy the demand response program. Compared with the conventional demand response strategy based on optimisation, the learnt strategy does not rely on the forecasting information as input and could adapt to the changing demand response incentive automatically. It may not produce the best result every time, but can guarantee the benefit in a non‐deterministic way in long‐term operation. The real‐world deployment of the Huangpu virtual power plant involving hardware and software platform is also introduced, as well as its future development projection. |
url |
https://doi.org/10.1049/gtd2.12179 |
work_keys_str_mv |
AT taochen optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning AT qiushicui optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning AT ciweigao optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning AT qinranhu optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning AT kexinglai optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning AT jianlinyang optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning AT ranlyu optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning AT haozhang optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning AT jinyuanzhang optimaldemandresponsestrategyofcommercialbuildingbasedvirtualpowerplantusingreinforcementlearning |
_version_ |
1721302753784889344 |