A Utility-Based Approach to Some Information Measures
We review a decision theoretic, i.e., utility-based, motivation for entropy and Kullback-Leibler relative entropy, the natural generalizations that follow, and various properties of thesegeneralized quantities. We then consider these generalized quantities in an easily interpreted spe-cial case. We...
Main Authors: | Sven Sandow, Jinggang Huang, Craig Friedman |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2007-01-01
|
Series: | Entropy |
Subjects: | |
Online Access: | http://www.mdpi.com/1099-4300/9/1/1/ |
Similar Items
-
Time Evolution of Relative Entropies for Anomalous Diffusion
by: Karl Heinz Hoffmann, et al.
Published: (2013-07-01) -
Tsallis Relative Entropy and Anomalous Diffusion
by: Karl Heinz Hoffmann, et al.
Published: (2012-04-01) -
Introduction of the Kullback – Leibler information function by means of partitions of the probability space
by: Edvard E. Sokal
Published: (2018-05-01) -
Parametric Bayesian Estimation of Differential Entropy and Relative Entropy
by: Maya Gupta, et al.
Published: (2010-04-01) -
Statistics and Machine Learning Experiments in English and Romanian Poetry
by: Ovidiu Calin
Published: (2020-12-01)