Control of HVAC-systems with Slow Thermodynamic Using Reinforcement Learning

Christian Blad, Søren Koch, Sajuran Ganeswarathas, Carsten Kallesøe, Simon Bøgh

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

4 Citationer (Scopus)
57 Downloads (Pure)

Abstrakt

This paper proposes an adaptive controller based on Reinforcement Learning (RL), which copes with HVAC-systems consisting of slow thermodynamics. Two different RL algorithms with Q-Networks (QNs) are investigated. The HVAC-system is in this study an underfloor heating system. Underfloor heating is of great interest because it is very common in Scandinavia, but this research can be applied to a wide range of HVAC-systems, industrial processes and other control applications that are dominated by very slow dynamics. The environments consist of one, two, and four zones within a house in a simulation environment meaning that agents will be exposed to gradually more complex environments separated into test levels. The novelty of this paper is the incorporation of two different RL algorithms for industrial process control; a QN and a QN + Eligibility Trace (QN+ET). The reason for using eligibility trace is that an underfloor heating environment is dominated by slow dynamics and by using eligibility trace the agent can find correlations between the reward and actions taken in earlier iterations.
OriginalsprogEngelsk
Titel29th International Conference on Flexible Automation and Intelligent Manufacturing : FAIM 2019
Antal sider8
Vol/bind38
ForlagElsevier
Publikationsdato2019
Sider1308-1315
DOI
StatusUdgivet - 2019
Begivenhed29th International Conference on Flexible Automation and Intelligent Manufacturing (FAIM2019) - Limerick, Irland
Varighed: 24 jun. 201928 jun. 2019
https://faim2019.org

Konference

Konference29th International Conference on Flexible Automation and Intelligent Manufacturing (FAIM2019)
Land/OmrådeIrland
ByLimerick
Periode24/06/201928/06/2019
Internetadresse
NavnProcedia Manufacturing
ISSN2351-9789

Emneord

  • Reinforcement Learning
  • Artificial intelligence
  • Sustainable Manufacturing Engineering
  • HVAC Systems

Fingeraftryk

Dyk ned i forskningsemnerne om 'Control of HVAC-systems with Slow Thermodynamic Using Reinforcement Learning'. Sammen danner de et unikt fingeraftryk.

Citationsformater