Metric Entropy
- Natural & Formal Sciences -
Mathematics & Logic Dictionary
Definition
Metric entropy at scale ε of a set S is the logarithm (usually base e or 2) of its covering number N(ε,S,ρ); it compresses the scale-dependent count of ε-balls into an additive quantity useful for information and learning bounds.