4.7 Article

Towards self-learning control of HVAC systems with the consideration of dynamic occupancy patterns: Application of model-free deep reinforcement learning

Related references

Note: Only part of the references are listed.
Article Construction & Building Technology

Cooling seasonal performance of inverter air conditioner using model prediction control for demand response

Cuiling Wang et al.

Summary: The supply-demand imbalance in smart grids poses challenges to power consumption and grid safety. Demand response control, particularly as applied to air conditioners, can help reduce peak energy consumption and save energy. Model predictive control (MPC) has been proven effective in this regard. This study examines the cooling performance of an inverter AC with MPC and demonstrates its superior performance compared to traditional control methods.

ENERGY AND BUILDINGS (2022)

Article Construction & Building Technology

Impact of occupancy prediction models on building HVAC control system performance: Application of machine learning techniques

Mohammad Esrafilian-Najafabadi et al.

Summary: This paper analyzes the impact of different types of occupancy prediction models on the performance of occupancy-based HVAC control systems in residential buildings. The results show that occupancy-state prediction models provide better performance in most cases.

ENERGY AND BUILDINGS (2022)

Article Construction & Building Technology

Impact of predictor variables on the performance of future occupancy prediction: Feature selection using genetic algorithms and machine learning

Mohammad Esrafilian-Najafabadi et al.

Summary: This study analyzes the impact of employing different features on the performance of future occupancy prediction models and proposes a multi-objective genetic algorithm to improve prediction performance. The results demonstrate the advantages of this algorithm in terms of accuracy and feature utilization, and identify key predictor variables.

BUILDING AND ENVIRONMENT (2022)

Article Construction & Building Technology

Occupancy and occupant activity drivers of energy consumption in residential buildings

Saba Akbari et al.

Summary: There is a growing interest in understanding the factors influencing households' load profiles and providing customized load-shifting and energy-saving recommendations based on their specific traits and routines. The study developed a data-driven framework to extract daily occupancy patterns, determine high-and low-energy consumption periods, and identify influencing activity factors of energy consumption. The results indicate notable variations in occupancy patterns between seasons and weekdays among different households.

ENERGY AND BUILDINGS (2021)

Article Construction & Building Technology

Occupancy-based HVAC control using deep learning algorithms for estimating online preconditioning time in residential buildings

Mohammad Esrafilian-Najafabadi et al.

Summary: This paper introduces a rule-based HVAC control system for estimating dynamic preconditioning time in residential buildings using a deep learning algorithm. The system performance is evaluated from various aspects to select the optimal control system and assess its sensitivity to temperature setback.

ENERGY AND BUILDINGS (2021)

Article Construction & Building Technology

Development and evaluation of data-driven controls for residential smart thermostats

Brent Huchuk et al.

Summary: The study compared three different HVAC control methods and found that MPC control had the lowest average cost, better linear model predictive capability, and did not subject occupants to the discomfort of system exploration compared to the other methods.

ENERGY AND BUILDINGS (2021)

Article Computer Science, Artificial Intelligence

t-soft update of target network for deep reinforcement learning

Taisuke Kobayashi et al.

Summary: A new robust update rule for deep reinforcement learning (DRL) target network, the t-soft update method, is proposed in this paper. Inspired by the Student-t distribution, the t-soft update automatically excludes extreme updates and mitigates learning delay, outperforming conventional methods in DRL.

NEURAL NETWORKS (2021)

Review Construction & Building Technology

State of the art review on model predictive control (MPC) in Heating Ventilation and Air-conditioning (HVAC) field

Ye Yao et al.

Summary: Building systems are complex and unpredictable, posing challenges for energy-saving control. Model predictive control (MPC) is a potential strategy to address these challenges. This paper provides a comprehensive view of MPC applications in building HVAC systems, discussing modeling techniques and optimization algorithms in detail.

BUILDING AND ENVIRONMENT (2021)

Review Construction & Building Technology

Occupancy-based HVAC control systems in buildings: A state-of-the-art review

Mohammad Esrafilian-Najafabadi et al.

Summary: Intelligent buildings utilize data from occupancy detection and monitoring networks to predict occupancy profiles and adjust HVAC operations to minimize energy consumption while maintaining thermal comfort and indoor air quality. Various occupancy-based control strategies have been proposed in the literature, with a focus on classification and evaluation of these strategies.

BUILDING AND ENVIRONMENT (2021)

Article Construction & Building Technology

Towards optimal control of air handling units using deep reinforcement learning and recurrent neural network

Zhengbo Zou et al.

BUILDING AND ENVIRONMENT (2020)

Review Construction & Building Technology

A review of the -state-of-the-art in data -driven approaches for building energy prediction

Ying Sun et al.

ENERGY AND BUILDINGS (2020)

Article Construction & Building Technology

Optimizing energy consumption and occupants comfort in open-plan offices using local control based on occupancy dynamic data

Shide Salimi et al.

BUILDING AND ENVIRONMENT (2020)

Article Construction & Building Technology

Deep reinforcement learning to optimise indoor temperature control and heating energy consumption in buildings

Silvio Brandi et al.

ENERGY AND BUILDINGS (2020)

Article Green & Sustainable Science & Technology

Evaluating the Adaptability of Reinforcement Learning Based HVAC Control for Residential Houses

Kuldeep Kurte et al.

SUSTAINABILITY (2020)

Review Energy & Fuels

Reinforcement learning for demand response: A review of algorithms and modeling techniques

Jose R. Vazquez-Canteli et al.

APPLIED ENERGY (2019)

Article Construction & Building Technology

Energy optimization associated with thermal comfort and indoor air control via a deep reinforcement learning algorithm

William Valladares et al.

BUILDING AND ENVIRONMENT (2019)

Article Construction & Building Technology

Comparison of machine learning models for occupancy prediction in residential buildings using connected thermostat data

Brent Huchuk et al.

BUILDING AND ENVIRONMENT (2019)

Proceedings Paper Energy & Fuels

Advanced Building Control via Deep Reinforcement Learning

Ruoxi Jia et al.

INNOVATIVE SOLUTIONS FOR ENERGY TRANSITIONS (2019)

Article Construction & Building Technology

Optimal control of HVAC and window systems for natural ventilation through reinforcement learning

Yujiao Chen et al.

ENERGY AND BUILDINGS (2018)

Review Construction & Building Technology

Rethinking the role of occupant behavior in building energy performance: A review

Yan Zhang et al.

ENERGY AND BUILDINGS (2018)

Article Energy & Fuels

Simulation-Based Evaluation and Optimization of Control Strategies in Buildings

Georgios D. Kontes et al.

ENERGIES (2018)

Review Green & Sustainable Science & Technology

Turning up the heat on obsolete thermostats: A simulation-based comparison of intelligent control approaches for residential heating systems

Florian Nagele et al.

RENEWABLE & SUSTAINABLE ENERGY REVIEWS (2017)

Proceedings Paper Green & Sustainable Science & Technology

Energy efficient building HVAC control algorithm with real-time occupancy prediction

Jie Shi et al.

8TH INTERNATIONAL CONFERENCE ON SUSTAINABILITY IN ENERGY AND BUILDINGS, SEB-16 (2017)

Article Construction & Building Technology

Satisfaction based Q-learning for integrated lighting and blind control

Zhijin Cheng et al.

ENERGY AND BUILDINGS (2016)

Article Multidisciplinary Sciences

Human-level control through deep reinforcement learning

Volodymyr Mnih et al.

NATURE (2015)

Article Construction & Building Technology

Model predictive HVAC control with online occupancy model

Justin R. Dobbs et al.

ENERGY AND BUILDINGS (2014)

Article Construction & Building Technology

Predicting household occupancy for smart heating control: A comparative performance analysis of state-of-the-art approaches

Wilhelm Kleiminger et al.

ENERGY AND BUILDINGS (2014)

Article Energy & Fuels

Model-based predictive control of an ice storage device in a building cooling system

J. A. Candanedo et al.

APPLIED ENERGY (2013)

Article Energy & Fuels

Importance of occupancy information for building climate control

Frauke Oldewurtel et al.

APPLIED ENERGY (2013)