Shannon Entropy Natural & Formal Sciences Dictionary Definition A quantitative measure of the uncertainty or average information content of a discrete probability distribution, defined as H = -Σ p(x) log p(x).
Shannon Entropy Natural & Formal Sciences Dictionary Definition A quantitative measure of the uncertainty or average information content of a discrete probability distribution, defined as H = -Σ p(x) log p(x).