Does the Time Between Scoring Sessions Impact Scoring Accuracy? An Evaluation of Constructed-Response Essay Responses on the GRE® General Test

This report investigates whether the time between scoring sessions has an influence on operational and nonoperational scoring accuracy. The study evaluates raters' scoring accuracy on constructed-response essay responses for the GRE® General Test. Binomial linear mixed-effect models are present...

Full description

Bibliographic Details
Main Authors: Arslan, B. (Author), Finn, B. (Author), Ricker-Pedley, K.L (Author), Wendler, C. (Author)
Format: Article
Language:English
Published: John Wiley and Sons Inc 2018
Subjects:
Online Access:View Fulltext in Publisher
LEADER 01522nam a2200205Ia 4500
001 10.1002-ets2.12217
008 220706s2018 CNT 000 0 und d
020 |a 23308516 (ISSN) 
245 1 0 |a Does the Time Between Scoring Sessions Impact Scoring Accuracy? An Evaluation of Constructed-Response Essay Responses on the GRE® General Test 
260 0 |b John Wiley and Sons Inc  |c 2018 
856 |z View Fulltext in Publisher  |u https://doi.org/10.1002/ets2.12217 
520 3 |a This report investigates whether the time between scoring sessions has an influence on operational and nonoperational scoring accuracy. The study evaluates raters' scoring accuracy on constructed-response essay responses for the GRE® General Test. Binomial linear mixed-effect models are presented that evaluate how the effect of various predictors, such as time spent scoring each response, days in a scoring gap, and number of consecutive days of scoring, relate to scoring accuracy. Results suggest that for operational scoring, the number of days in a scoring gap has a negative influence on performance. The findings, as well as other results from the models, are discussed in the context of cognitive influences on knowledge and skill retention. © 2018 Educational Testing Service 
650 0 4 |a CR scoring 
650 0 4 |a forgetting over time 
650 0 4 |a GRE® General Test 
700 1 |a Arslan, B.  |e author 
700 1 |a Finn, B.  |e author 
700 1 |a Ricker-Pedley, K.L.  |e author 
700 1 |a Wendler, C.  |e author 
773 |t ETS Research Report Series