Mutual Information

Natural & Formal Sciences Dictionary
A nonnegative scalar that quantifies the amount of statistical dependence between two random variables by measuring how much knowing one reduces uncertainty about the other.