Entropy Rate
Natural & Formal Sciences Dictionary
Definition
The long-run average Shannon information produced per symbol by a stochastic process, typically defined as the limit H = lim_{n→∞} (1/n) H(X1,...,Xn) or equivalently H = lim_{n→∞} H(Xn | X1,...,Xn−1) when the limit exists.