Autonomous hvac control, a reinforcement learning approach

View/ Open
Date
2015-08-29Author
Barrett, Enda
Linder, Stephen
Metadata
Show full item recordUsage
This item's downloads: 1137 (view details)
Cited 40 times in Scopus (view citations)
Recommended Citation
Barrett, Enda, & Linder, Stephen. (2015). Autonomous HVAC Control, A Reinforcement Learning Approach. In Albert Bifet, Michael May, Bianca Zadrozny, Ricard Gavalda, Dino Pedreschi, Francesco Bonchi, Jaime Cardoso & Myra Spiliopoulou (Eds.), Machine Learning and Knowledge Discovery in Databases: European Conference, ECML PKDD 2015, Porto, Portugal, September 7-11, 2015, Proceedings, Part III (pp. 3-19). Cham: Springer International Publishing.
Published Version
Abstract
Abstract—Recent high profile developments of autonomous
learning thermostats by companies such as Nest Labs and
Honeywell have brought to the fore the possibility of ever greater
numbers of intelligent devices permeating our homes and working
environments into the future. However, the specific learning
approaches and methodologies utilised by these devices have
never been made public. In fact little information is known as to
the specifics of how these devices operate and learn about their
environments or the users who use them. This paper proposes a
suitable learning architecture for such an intelligent thermostat
in the hope that it will benefit further investigation by the
research community. Our architecture comprises a number of
different learning methods each of which contributes to create a
complete autonomous thermostat capable of controlling a HVAC
system. A novel state action space formalism is proposed to
enable a Reinforcement Learning agent to successfully control the
HVAC system by optimising both occupant comfort and energy
costs. Our results show that the learning thermostat can achieve
cost savings of 10% over a programmable thermostat, whilst
maintaining high occupant comfort standards.