 ##  [Information Bottleneck Principle](/information-bottleneck-principle) 

  ##  [Information Bottleneck Principle](https://natural.quantumdictionary.io/information-bottleneck-principle-0) 

  
 [![Natural & Formal Sciences Dictionary](/sites/default/files/styles/large/public/2026-01/Natural%20%26%20Formal%20Sciences.png.webp?itok=2kCDRVQv)](/topic-specific-dictionaries/natural-formal-sciences)


**Natural &amp; Formal Sciences Dictionary**

 
Definition

A principled framework for deriving compressed representations of an input variable that preserve as much relevant information as possible about a specified target variable, trading off compactness against predictive fidelity.