The Unintended Effects of Policy-Assigned Teacher Observations: Examining the Validity of Observation Scores

Several state policies link high-stakes consequences to teacher evaluations, which tend to be heavily weighted by observation scores. However, research has only recently investigated the validity of these scores in field settings. This study examines the sensitivity of teacher observation scores to...

Full description

Bibliographic Details
Main Author: Seth B. Hunter
Format: Article
Language:English
Published: SAGE Publishing 2020-06-01
Series:AERA Open
Online Access:https://doi.org/10.1177/2332858420929276
Description
Summary:Several state policies link high-stakes consequences to teacher evaluations, which tend to be heavily weighted by observation scores. However, research has only recently investigated the validity of these scores in field settings. This study examines the sensitivity of teacher observation scores to the number of observations assigned by state policy and the assignment of prior-year composite measures produced by the evaluation system. Regression discontinuity and local regression designs exploit discontinuities in both assignment processes. The evidence suggests that assignment to a lower prior-year composite score does not bias observation scores, but the assignment to more policy-assigned observations introduces substantial negative bias. The degree of negative bias is most pronounced among early-career teachers, as suggested by theory. Implications are discussed.
ISSN:2332-8584