Estimating entropy of distributions in constant space
We consider the task of estimating the entropy of k-ary distributions from samples in the streaming model, where space is limited. Our main contribution is an algorithm that requires O ( klog(1"3/")2 ) samples and a constant O(1) memory words of space and outputs a ±" estimate of H(p)...
Main Author: | Indyk, Piotr (Author) |
---|---|
Other Authors: | Massachusetts Institute of Technology. Department of Electrical Engineering and Computer Science (Contributor) |
Format: | Article |
Language: | English |
Published: |
Neural Information Processing Systems Foundation,
2021-01-25T19:53:49Z.
|
Subjects: | |
Online Access: | Get fulltext |
Similar Items
-
Space and time efficient kernel density estimation in high dimensions
by: Indyk, Piotr, et al.
Published: (2021) -
Sample-Optimal Fourier Sampling in Any Constant Dimension
by: Indyk, Piotr, et al.
Published: (2017) -
On the Entropy of Deformed Phase Space Black Hole and the Cosmological Constant
by: Andrés Crespo-Hernández, et al.
Published: (2017-02-01) -
Cosmological Constant from the Entropy Balance Condition
by: Merab Gogberashvili
Published: (2018-01-01) -
Estimation of different types of entropies for the Kumaraswamy distribution.
by: Abdulhakim A Al-Babtain, et al.
Published: (2021-01-01)