Towards Machine Learning-based Model Predictive Control for HVAC Control in Multi-Context Buildings at Scale via Ensemble Learning

TL;DR

This paper introduces a hierarchical reinforcement learning framework that dynamically combines ensemble models to improve HVAC control predictions in multi-context buildings, reducing data collection efforts and enhancing adaptability.

Contribution

It proposes a novel HRL-based ensemble method for HVAC prediction that adapts to non-stationary building data and simplifies model reuse across different environments.

Findings

Effective model selection and weighting demonstrated in experiments

Reduces data collection and expert knowledge requirements

Improves prediction accuracy in diverse building contexts

Abstract

The building thermodynamics model, which predicts real-time indoor temperature changes under potential HVAC (Heating, Ventilation, and Air Conditioning) control operations, is crucial for optimizing HVAC control in buildings. While pioneering studies have attempted to develop such models for various building environments, these models often require extensive data collection periods and rely heavily on expert knowledge, making the modeling process inefficient and limiting the reusability of the models. This paper explores a model ensemble perspective that utilizes existing developed models as base models to serve a target building environment, thereby providing accurate predictions while reducing the associated efforts. Given that building data streams are non-stationary and the number of base models may increase, we propose a Hierarchical Reinforcement Learning (HRL) approach to dynamically select and weight the base models. Our approach employs a two-tiered decision-making process: the high-level focuses on model selection, while the low-level determines the weights of the selected models. We thoroughly evaluate the proposed approach through offline experiments and an on-site case study, and the experimental results demonstrate the effectiveness of our method.