期刊
BUILDING AND ENVIRONMENT
卷 226, 期 -, 页码 -出版社
PERGAMON-ELSEVIER SCIENCE LTD
DOI: 10.1016/j.buildenv.2022.109747
关键词
Double deep Q-networks; Model predictive control (MPC); Self-learning control; Occupancy patterns; Energy efficiency
资金
- Concordia University-Canada through the Concordia Research Chair-Energy Environment
This study proposes a self-learning control system that can learn occupancy profiles, building energy consumption patterns, and lag-time of the HVAC systems. The system learns by interacting with the environment without using any models. The results show that the proposed method performs well in maintaining thermal comfort.
This study proposes a self-learning control system that aims to learn occupancy profiles, building energy con-sumption patterns, and lag-time of the heating, ventilation, and air-conditioning (HVAC) systems. The control system learns by interacting with the environment with no need to develop building models and occupancy prediction models. The controller is developed based on a double deep Q-networks (DDQN) algorithm, as a model-free reinforcement learning method. The system's performance is evaluated and compared with that of a model predictive control (MPC) system under two scenarios of perfect and actual occupancy predictions based on occupancy data collected from 20 residential units. The MPC is assisted by a genetic algorithm and supervised learning models for predicting future occupancy patterns, indoor operative temperature, and building energy consumption. The results show that in the case of using perfect occupancy prediction, the self-learning controller operates almost as well as the MPC while not requiring any models. When occupancy prediction uncertainty is added to the problem, the proposed method outperforms the MPC in terms of thermal comfort by increasing the average temperature deviation and deviation period by 0.24 degrees C and 7.87%, respectively. However, the DDQN agent causes significant thermal comfort violations during the initial training period. The system causes up to a 2.8% longer deviation period and a 0.32 degrees C higher average temperature deviation, compared with the perfor-mance of the fully-trained system.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据