GeoIB: Geometry-Aware Information Bottleneck via Statistical-Manifold Compression
arXiv:2602.03906v1 Announce Type: cross Abstract: Information Bottleneck (IB) is widely used, but in deep learning, it is usually implemented through tractable surrogates, such as variational bounds or neural mutual information (MI) estimators, rather than directly controlling the MI I(X;Z) itself. The looseness and estimator-dependent bias can make IB “compression” only indirectly controlled and optimization fragile. We revisit the IB problem through the lens of information geometry and propose a textbf{Geo}metric textbf{I}nformation textbf{B}ottleneck (textbf{GeoIB}) that dispenses with mutual information […]