Safe Reinforcement Learning Control for Water Distribution Networks

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

1 Citation (Scopus)

Abstract

Reinforcement Learning (RL) is an optimal control method for regulating the behaviour of a dynamical system when the system model is unknown. This feature is a strong advantage for controlling systems, such as Water Distribution
Networks, where it is difficult to have a reliable model. When learning an optimal policy with RL, the exploration phase implies high degree of uncertainty in the system operation. Large scale infrastructures such as WDN require a robust operation since they cannot afford fails during the operation. This paper presents a model-free control method which provides safety in the operation while learning an optimal policy. This method introduces a policy supervisor block in the control loop which assesses the safety of the learned policy in real-time.
The safety verification consists of evaluating the trajectory on a standard linear model. In this model only the fundamental linear dynamics are represented and the system’s dimensions do not require to be expressed with high accuracy. If the predicted trajectory violates the boundaries, the supervisor provides a safe control action. Simulation and experimental results prove the applicability of the proposed method.
Original languageEnglish
Title of host publication2021 IEEE Conference on Control Technology and Applications (CCTA)
Number of pages6
PublisherIEEE
Publication dateAug 2021
Pages1148-1153
Article number9659138
ISBN (Print)978-1-6654-3644-1
ISBN (Electronic)978-1-6654-3643-4
DOIs
Publication statusPublished - Aug 2021
Event2021 IEEE Conference on Control Technology and Applications (CCTA) - San Diego, United States
Duration: 9 Aug 202111 Aug 2021

Conference

Conference2021 IEEE Conference on Control Technology and Applications (CCTA)
Country/TerritoryUnited States
CitySan Diego
Period09/08/202111/08/2021
SeriesIEEE Conference on Control Technology and Applications (CCTA) - Proceedings
ISSN2768-0762

Fingerprint

Dive into the research topics of 'Safe Reinforcement Learning Control for Water Distribution Networks'. Together they form a unique fingerprint.

Cite this