Information Bottleneck Principle

Natural & Formal Sciences Dictionary
A principled framework for deriving compressed representations of an input variable that preserve as much relevant information as possible about a specified target variable, trading off compactness against predictive fidelity.