Markov Chains and Stochastic Stability (Cambridge Mathematical Library)

Markov Processes for Stochastic Modeling

Markov Chains and Stochastic Processes Practice Problems Workbook: 500+ Markov Chains and Stochastic Processes Practice Problems with Full Step by Step Solutions (Math Magicians)

Stochastic Processes for Actuarial Applications: Markov Chains, Poisson Processes, and Beyond (Actuary Mastery Series II – The Advanced Collection)

Stochastic Processes for Actuarial Applications: Markov Chains, Poisson Processes, and Beyond: 3 (Actuary Mastery Series II – The Advanced Collection)