Shannon Entropy

Natural & Formal Sciences Dictionary
Definition
A quantitative measure of the uncertainty or average information content of a discrete probability distribution, defined as H = -Σ p(x) log p(x).