期刊
ENTROPY
卷 13, 期 11, 页码 1945-1957出版社
MDPI
DOI: 10.3390/e13111945
关键词
Shannon entropy; Tsallis entropy; information theory; measure-preserving function
资金
- EU STREP QCS
- EPSRC
- EPSRC [EP/D073537/1] Funding Source: UKRI
- Engineering and Physical Sciences Research Council [EP/D073537/1] Funding Source: researchfish
There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the entropy of a probability measure on a finite set, this characterization focuses on the information loss, or change in entropy, associated with a measure-preserving function. Information loss is a special case of conditional entropy: namely, it is the entropy of a random variable conditioned on some function of that variable. We show that Shannon entropy gives the only concept of information loss that is functorial, convex-linear and continuous. This characterization naturally generalizes to Tsallis entropy as well.
作者
我是这篇论文的作者
点击您的名字以认领此论文并将其添加到您的个人资料中。
推荐
暂无数据