A Bayesian hierarchical latent trait model for estimating rater bias and reliability in large-scale performance assessment.
We propose a novel approach to modelling rater effects in scoring-based assessment. The approach is based on a Bayesian hierarchical model and simulations from the posterior distribution. We apply it to large-scale essay assessment data over a period of 5 years. Empirical results suggest that the mo...
Main Authors: | Kaja Zupanc, Erik Štrumbelj |
---|---|
Format: | Article |
Language: | English |
Published: |
Public Library of Science (PLoS)
2018-01-01
|
Series: | PLoS ONE |
Online Access: | http://europepmc.org/articles/PMC5882162?pdf=render |
Similar Items
-
Study on Inter-raters Reliability under the Latent Trait Model through Derangement
by: Shan-Pang Liu, et al.
Published: (2009) -
Estimating the Intra-Rater Reliability of Essay Raters
by: Yoav Cohen
Published: (2017-09-01) -
A Bayesian approach to time-varying latent strengths in pairwise comparisons.
by: Blaž Krese, et al.
Published: (2021-01-01) -
Intra-rater and inter-rater reliability of hemoglobin color scale method
by: Agampodi S, et al.
Published: (2009-01-01) -
The Hierarchical Rater Thresholds Model for Multiple Raters and Multiple Items
by: Molenaar Dylan, et al.
Published: (2021-01-01)