Control of HVAC-Systems Using Reinforcement Learning With Hysteresis and Tolerance Control

Christian Blad*, Carsten Kallesøe, Simon Bøgh

*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

Abstract

This paper presents the idea of using tolerance control in Deep Reinforcement Learning to improve robustness and reduce training time. This paper is a continuation of [1] where it is shown that Reinforcement Learning (RL) can be used to control an underfloor heating (UFH) system. However, it is seen in the study that the initial training time is too high and that the performance during training is not fulfilling the requirements to a UFH system. In this paper the fundamental challenge regarding control of UFH systems is explained, how RL can be beneficial for control of UFH systems, and how the implementation is done. Furthermore, results are presented with a standard hysteresis control, an RL control, and an RL control with tolerance control. These results show that the effect of tolerance control in these types of systems is significant. Finally, we discuss the challenges there are for a real-world implementation of RL-based control in UFH system.
Original languageEnglish
Title of host publicationIEEE/SICE International Symposium on System Integration
Number of pages5
PublisherIEEE
Publication date2020
Pages938-942
Article number9026189
ISBN (Electronic)9781728166674
DOIs
Publication statusPublished - 2020
EventIEEE/SICE International Symposium on System Integration - Hawaii Convention Center, Honolulu, United States
Duration: 12 Jan 202015 Jan 2020

Conference

ConferenceIEEE/SICE International Symposium on System Integration
LocationHawaii Convention Center
Country/TerritoryUnited States
CityHonolulu
Period12/01/202015/01/2020
SeriesProceedings of the 2020 IEEE/SICE International Symposium on System Integration
ISSN2474-2325

Keywords

  • Deep Reinforcement Learning
  • Artificial Intelligence (AI)
  • Deep Learning
  • HVAC System
  • Hysteresis
  • tolerance control
  • HVAC-systems
  • Tolerance Control
  • Underfloor Heating

Fingerprint

Dive into the research topics of 'Control of HVAC-Systems Using Reinforcement Learning With Hysteresis and Tolerance Control'. Together they form a unique fingerprint.

Cite this