Markov Chain

A stochastic process that progresses through a discrete set of states in discrete time (or in a discrete-indexed sequence) with the memoryless property that the probability distribution of the next state depends only on the current state, not on the earlier history.