Markov chain

Definition

A discrete-time stochastic process containing a Markov property.

Example Sentences

• "The probability density of the Bayseian posterior was estimated by Metropolis-coupled Markov chain Monte Carlo, with multiple incrementally heated chains."