Controller Synthesis for Markov Decision Processes with Branching - Time Objectives – RNDr. Vojtěch Forejt, Ph.D., LL.B. (Hons)
RNDr. Vojtěch Forejt, Ph.D., LL.B. (Hons)
Doctoral thesis
Controller Synthesis for Markov Decision Processes with Branching - Time Objectives
Controller Synthesis for Markov Decision Processes with Branching - Time Objectives
Abstract:
Tato práce obsahuje výsledky z oblasti syntézy plánovačů pro konečněstavové Markovovy rozhodovací procesy a logiky větvícího se času. Markovovův rozhodovací proces je pravděpodobnostní systém často využívaný při modelování skutečných systémů, ve kterých se vyskytuje jak nedeterministické, tak pravděpodobnostní chování. Logiky větvícího se času umožňují vyjádřit požadované vlastnosti těchto systémů …moreAbstract:
This thesis studies controller synthesis and verification problems for finite state Markov decision processes and branching-time logics. Markov decision processes are probabilistic systems that arise naturally in modelling of real-life systems with both nondeterministic and stochastic behaviour, while branching-time logics are formalisms allowing one to reason about properties of systems. The controller …more
Language used: English
Date on which the thesis was submitted / produced: 3. 11. 2009
Identifier:
https://is.muni.cz/th/yvwbl/
Thesis defence
- Date of defence: 17. 12. 2009
- Supervisor: prof. RNDr. Antonín Kučera, Ph.D.
- Reader: prof. RNDr. Petr Jančar, CSc., Patricia Bouyer-Decitre
Citation record
ISO 690-compliant citation record:
FOREJT, Vojtěch. \textit{Controller Synthesis for Markov Decision Processes with Branching - Time Objectives}. Online. Doctoral theses, Dissertations. Brno: Masaryk University, Faculty of Informatics. 2009. Available from: https://theses.cz/id/c8cj60/.
Full text of thesis
Contents of on-line thesis archive
Published in Theses:- světu
Other ways of accessing the text
Institution archiving the thesis and making it accessible: Masarykova univerzita, Fakulta informatikyMasaryk University
Faculty of InformaticsDoctoral programme / field:
Informatics (4-years) / Informatics
Theses on a related topic
-
Markov Decision Processes with Multiple Resource Constraints
Jaroslav Pospíšek -
Synthesizing Resource-Shielded Policies for Partially Observable Markov Decision Processes
Šimon Brlej -
Efficient Verification of Multi-Objective Queries in Markov Decision Processes
Vít Unčovský -
Pareto Front Estimation in Risk-Constrained Markov Decision Processes
Martin Kurečka -
Reinforcement Learning of Risk-Averse Policies in Markov Decision Processes
Jiří Vahala -
Unified View on Multiple Mean-Payoff Objectives in Markov Decision Processes
Zuzana Komárková -
Monte Carlo Tree Search in Verification of Markov Decision Processes
Ondřej Slámečka -
Fundamental Properties of Probabilistic Branching-Time Logics
Jan Křetínský