A Hemimetric Extension of Simulation for Semi-Markov Decision Processes

Publikation: Bidrag til bog/antologi/rapport/konference proceedingKonferenceartikel i proceedingForskningpeer review

1 Citationer (Scopus)
105 Downloads (Pure)

Abstrakt

Semi-Markov decision processes (SMDPs) are continuous-time Markov decision processes where the residence-time on states is governed by generic distributions on the positive real line.

In this paper we consider the problem of comparing two SMDPs with respect to their time-dependent behaviour. We propose a hemimetric between processes, which we call simulation distance, measuring the least acceleration factor by which a process needs to speed up its actions in order to behave at least as fast as another process. We show that this distance can be computed in time O(n^2 (f(l) + k) + mn^7), where n is the number of states, m the number of actions, k the number of atomic propositions, and f(l) the complexity of comparing the residence-time between states. The theoretical relevance and applicability of this distance is further argued by showing that
(i) it is suitable for compositional reasoning with respect to CSP-like parallel composition and
(ii) has a logical characterisation in terms of a simple Markovian logic.
OriginalsprogEngelsk
TitelQuantitative Evaluation of Systems : 15th International Conference, QEST 2018, Beijing, China, September 4-7, 2018, Proceedings
RedaktørerAnabelle McIver, Andras Horvath
Antal sider17
ForlagSpringer
Publikationsdato4 sep. 2018
Sider339-355
ISBN (Trykt)978-3-319-99153-5
ISBN (Elektronisk)978-3-319-99154-2
DOI
StatusUdgivet - 4 sep. 2018
BegivenhedQuantitative Evaluation of Systems 2018 - Beijing, Kina
Varighed: 4 sep. 20187 sep. 2018
http://www.qest.org/qest2018/

Konference

KonferenceQuantitative Evaluation of Systems 2018
LandKina
ByBeijing
Periode04/09/201807/09/2018
Internetadresse
NavnLecture Notes in Computer Science
Vol/bind11024
ISSN0302-9743

Emneord

  • semi-markov process
  • markov decision process
  • simulation
  • hemimetric

Fingeraftryk Dyk ned i forskningsemnerne om 'A Hemimetric Extension of Simulation for Semi-Markov Decision Processes'. Sammen danner de et unikt fingeraftryk.

Citationsformater