Variance constraints strongly influenced model performance in growth mixture modeling: a simulation and empirical study

• Main Authors: Jitske J. Sijbrandij, Tialda Hoekstra, Josué Almansa, Margot Peeters, Ute Bültmann, Sijmen A. Reijneveld
• Format: Article
• Language: English
• Published: BMC 2020-11-01
• Series: BMC Medical Research Methodology
• Subjects: Simulation studies; Longitudinal studies; Developmental trajectories; Growth mixture model; Variance misspecification; Model selection
• Online Access: http://link.springer.com/article/10.1186/s12874-020-01154-0

Abstract Background Growth Mixture Modeling (GMM) is commonly used to group individuals on their development over time, but convergence issues and impossible values are common. This can result in unreliable model estimates. Constraining variance parameters across classes or over time can solve these issues, but can also seriously bias estimates if variances differ. We aimed to determine which variance parameters can best be constrained in Growth Mixture Modeling. Methods To identify the variance constraints that lead to the best performance for different sample sizes, we conducted a simulation study and next verified our results with the TRacking Adolescent Individuals’ Lives Survey (TRAILS) cohort. Results If variance parameters differed across classes and over time, fitting a model without constraints led to the best results. No constrained model consistently performed well. However, the model that constrained the random effect variance and residual variances across classes consistently performed very poorly. For a small sample size (N = 100) all models showed issues. In TRAILS, the same model showed substantially different results from the other models and performed poorly in terms of model fit. Conclusions If possible, a Growth Mixture Model should be fit without any constraints on variance parameters. If not, we recommend to try different variance specifications and to not solely rely on the default model, which constrains random effect variances and residual variances across classes. The variance structure must always be reported Researchers should carefully follow the GRoLTS-Checklist when analyzing and reporting trajectory analyses.