Markov Processes (Advances in Applied Mathematics)

Theory of Markov Processes

Markov Processes for Stochastic Modeling

Markov Decision Processes and Reinforcement Learning

Stochastic Processes for Actuarial Applications: Markov Chains, Poisson Processes, and Beyond (Actuary Mastery Series II – The Advanced Collection)