Equiprobable discrete models of site-specific substitution rates underestimate the extent of rate variability.

• Main Authors: Frank Mannino, Sadie Wisotsky, Sergei L Kosakovsky Pond, Spencer V Muse
• Format: Article
• Language: English
• Published: Public Library of Science (PLoS) 2020-01-01
• Series: PLoS ONE
• Online Access: https://doi.org/10.1371/journal.pone.0229493

It is standard practice to model site-to-site variability of substitution rates by discretizing a continuous distribution into a small number, K, of equiprobable rate categories. We demonstrate that the variance of this discretized distribution has an upper bound determined solely by the choice of K and the mean of the distribution. This bound can introduce biases into statistical inference, especially when estimating parameters governing site-to-site variability of substitution rates. Applications to two large collections of sequence alignments demonstrate that this upper bound is often reached in analyses of real data. When parameter estimation is of primary interest, additional rate categories or more flexible modeling methods should be considered.