Introduction to Information Geometry, Recent Advances and Applications

Minicourse: Tuesday August 29th 2023.
School and workshop on Mapping the Interdisciplinary Horizons of AI: Risks, Alignment, Functional Programming, Information Geometry and Beyond
Where: Baltic Institute of Mathematics (hybrid format: Gothenburg, Sweden and online)
When: August 21st-September 1st 2023
 
Frank Nielsen
 

Information geometry primarily studies the geometric structures, dissimilarities, and statistical invariance of a family of probability distributions called the statistical model. A regular parametric statistical model can be geometrically handled as a Riemannian manifold equipped with the Fisher metric tensor which induces the Fisher-Rao geodesic distance. This Riemannian structure on the Fisher-Rao manifold was later generalized by a dual structure based on pairs of torsion-free affine connections coupled to the Fisher metric: The α-geometry. This dual structure casts light on the close interaction between statistical estimators in inference (maximum likelihood) and parametric statistical models (exponential families obtained from the principle of maximum entropy), and brings into play a generalized Pythagorean theorem useful to prove uniqueness of information projections. We will illustrate applications of information geometry in statistics, information theory, computer vision and pattern recognition, and learning of neural networks. The second part of the minicourse will present recent advances in information geometry and its applications.