High-order Markov chain models extend the conventional framework by incorporating dependencies that span several previous states rather than solely the immediate past. This extension allows for a ...

This paper deals with censoring of infinite-state banded Markov chains. Censoring involves reducing the time spent in states outside a certain set of states to 0 without affecting the number of visits ...

This paper gives an overview of recurrence and ergodicity properties of a Markov chain. Two new notions for ergodicity and recurrence are introduced. They are called μ -geometric ergodicity and μ ...

Goh, Joel, Mohsen Bayati, Stefanos A. Zenios, Sundeep Singh, and David Moore. "Data Uncertainty in Markov Chains: Application to Cost-Effectiveness Analyses of Medical Innovations." Operations ...