 ##  [Entropy Rate](/entropy-rate) 

  ##  [Entropy Rate](https://natural.quantumdictionary.io/entropy-rate-0) 

  

 [![Natural & Formal Sciences Dictionary](/sites/default/files/styles/large/public/2026-01/Natural%20%26%20Formal%20Sciences.png.webp?itok=2kCDRVQv)](/topic-specific-dictionaries/natural-formal-sciences)



**Natural &amp; Formal Sciences Dictionary**

 







 

 

 

 



 

 

 

 

Definition

The long-run average Shannon information produced per symbol by a stochastic process, typically defined as the limit H = lim_{n→∞} (1/n) H(X1,...,Xn) or equivalently H = lim_{n→∞} H(Xn | X1,...,Xn−1) when the limit exists.