Information Geometric Duality of ϕ-Deformed Exponential Families

Korbel, J., Hanel, R., & Thurner, S. (2019). Information Geometric Duality of ϕ-Deformed Exponential Families. Entropy 21 (2) p. 112. 10.3390/e21020112.

[thumbnail of entropy-21-00112.pdf]
Preview
Text
entropy-21-00112.pdf - Published Version
Available under License Creative Commons Attribution.

Download (1MB) | Preview

Abstract

In the world of generalized entropies—which, for example, play a role in physical systems with sub- and super-exponential phase space growth per degree of freedom—there are two ways for implementing constraints in the maximum entropy principle: linear and escort constraints. Both appear naturally in different contexts. Linear constraints appear, e.g., in physical systems, when additional information about the system is available through higher moments. Escort distributions appear naturally in the context of multifractals and information geometry. It was shown recently that there exists a fundamental duality that relates both approaches on the basis of the corresponding deformed logarithms (deformed-log duality). Here, we show that there exists another duality that arises in the context of information geometry, relating the Fisher information of ϕ -deformed exponential families that correspond to linear constraints (as studied by J.Naudts) to those that are based on escort constraints (as studied by S.-I. Amari). We explicitly demonstrate this information geometric duality for the case of (c,d) -entropy, which covers all situations that are compatible with the first three Shannon–Khinchin axioms and that include Shannon, Tsallis, Anteneodo–Plastino entropy, and many more as special cases. Finally, we discuss the relation between the deformed-log duality and the information geometric duality and mention that the escort distributions arising in these two dualities are generally different and only coincide for the case of the Tsallis deformation.

Item Type: Article
Uncontrolled Keywords: generalized entropy; ϕ-deformed family; Fisher information; information geometry; Cramér–Rao bound; (c,d)-entropy
Research Programs: Advanced Systems Analysis (ASA)
Depositing User: Luke Kirwan
Date Deposited: 04 Mar 2019 14:30
Last Modified: 27 Aug 2021 17:31
URI: https://pure.iiasa.ac.at/15780

Actions (login required)

View Item View Item