Surprisal

A pointwise information-theoretic measure of how unexpected a linguistic unit is given its context, defined as the negative logarithm of the conditional probability of the unit (−log P(unit | context)); typically expressed in bits when log base 2 is used.