Markov Processes (Advances in Applied Mathematics)

Theory of Markov Processes

Markov Processes for Stochastic Modeling

Markov Decision Processes and Reinforcement Learning

Markov Chains and Decision Processes for Engineers and Managers