Nearest Neighbor Estimates of Entropy for Multivariate Circular Distributions

• Main Authors: Neeraj Misra, Harshinder Singh, Vladimir Hnizdo
• Format: Article
• Language: English
• Published: MDPI AG 2010-05-01
• Series: Entropy
• Subjects: circular random variables; differential entropy; non-parametric estimation; nearest neighbor; circular distance; molecular simulation
• Online Access: http://www.mdpi.com/1099-4300/12/5/1125/

In molecular sciences, the estimation of entropies of molecules is important for the understanding of many chemical and biological processes. Motivated by these applications, we consider the problem of estimating the entropies of circular random vectors and introduce non-parametric estimators based on circular distances between n sample points and their k th nearest neighbors (NN), where k (≤ n – 1) is a fixed positive integer. The proposed NN estimators are based on two different circular distances, and are proven to be asymptotically unbiased and consistent. The performance of one of the circular-distance estimators is investigated and compared with that of the already established Euclidean-distance NN estimator using Monte Carlo samples from an analytic distribution of six circular variables of an exactly known entropy and a large sample of seven internal-rotation angles in the molecule of tartaric acid, obtained by a realistic molecular-dynamics simulation.