Entropy Measures vs. Kolmogorov Complexity

Entropy Measures vs. Kolmogorov Complexity

Kolmogorov complexity and Shannon entropy are conceptually different measures. However, for any recursive probability distribution, the expected value of Kolmogorov complexity equals its Shannon entropy, up to a constant. We study if a similar relationship holds for R´enyi and Tsallis entropies of o...

Full description

Bibliographic Details
Main Authors: Luís Antunes, André Souto, Andreia Teixeira, Armando Matos
Format: Article
Language:English
Published: MDPI AG 2011-03-01
Series:Entropy
Subjects:
Kolmogorov complexity
Shannon entropy
Rényi entropy
Tsallis entropy
Online Access:http://www.mdpi.com/1099-4300/13/3/595/

Internet

http://www.mdpi.com/1099-4300/13/3/595/

Similar Items