Discrete-Time Markov Control Processes
This text provides a unified treatment of some recent theoretical developments on Markov control processes. Interest is mainly confined to MCPs with Borel st... »

Continuous-Time Markov Decision Processes
Continuous-Time Markov Decision Processes »

Further Topics on Discrete-Time Markov Control Processes
A Markov process is a sequence in which the probability of a given state depends on the even or state immediately preceding it. This discussion is of Markov ... »

Adaptive Markov Control Processes
 »

Markov Chains and Invariant Probabilities
 »

Selected Topics on Continuous-time Controlled Markov Chains and Markov Games
Time Controlled Markov Chains And Markov Games »