The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach

When a cognitive ability is assessed repeatedly, test scores and ability estimates are often observed to increase across test sessions. This phenomenon is known as the retest (or practice) effect. One explanation for retest effects is that situational test anxiety interferes with a testee’...

Full description

Bibliographic Details
Main Authors: David Jendryczko, Jana Scharfen, Heinz Holling
Format: Article
Language:English
Published: MDPI AG 2019-09-01
Series:Journal of Intelligence
Subjects:
Online Access:https://www.mdpi.com/2079-3200/7/4/22
id doaj-026c899e03b04f68a2849f6e3d7b819c
record_format Article
spelling doaj-026c899e03b04f68a2849f6e3d7b819c2020-11-25T01:18:04ZengMDPI AGJournal of Intelligence2079-32002019-09-01742210.3390/jintelligence7040022jintelligence7040022The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling ApproachDavid Jendryczko0Jana Scharfen1Heinz Holling2Institute of Psychology, Westfälische Wilhelms-Universität Münster, 48149 Münster, GermanyInstitute of Psychology, Westfälische Wilhelms-Universität Münster, 48149 Münster, GermanyInstitute of Psychology, Westfälische Wilhelms-Universität Münster, 48149 Münster, GermanyWhen a cognitive ability is assessed repeatedly, test scores and ability estimates are often observed to increase across test sessions. This phenomenon is known as the retest (or practice) effect. One explanation for retest effects is that situational test anxiety interferes with a testee’s performance during earlier test sessions, thereby creating systematic measurement bias on the test items (interference hypothesis). Yet, the influence of anxiety diminishes with test repetitions. This explanation is controversial, since the presence of measurement bias during earlier measurement occasions cannot always be confirmed. It is argued that people from the lower end of the ability spectrum become aware of their deficits in test situations and therefore report higher anxiety (deficit hypothesis). In 2014, a structural equation model was proposed that specifically allows the comparison of these two hypotheses with regard to explanatory power for the negative anxiety−ability correlation found in cross-sectional assessments. We extended this model for usage in longitudinal studies to investigate the impact of test anxiety on test performance and on retest effects. A latent neighbor-change growth curve was implemented into the model that enables an estimation of retest effects between all pairs of successive test sessions. Systematic restrictions on model parameters allow testing the hypothetical reduction in anxiety interference over the test sessions, which can be compared to retest effect sizes. In an empirical study with seven measurement occasions, we found that a substantial reduction in interference upon the second test session was associated with the largest retest effect in a figural matrices test, which served as a proxy measure for general intelligence. However, smaller retest effects occurred up to the fourth test administration, whereas evidence for anxiety-induced measurement bias was only produced for the first two test sessions. Anxiety and ability were not negatively correlated at any time when the interference effects were controlled for. Implications, limitations, and suggestions for future research are discussed.https://www.mdpi.com/2079-3200/7/4/22retest effectpractice effectcognitive abilitiesintelligencefigural matricestest anxietystructural equation modeling
collection DOAJ
language English
format Article
sources DOAJ
author David Jendryczko
Jana Scharfen
Heinz Holling
spellingShingle David Jendryczko
Jana Scharfen
Heinz Holling
The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach
Journal of Intelligence
retest effect
practice effect
cognitive abilities
intelligence
figural matrices
test anxiety
structural equation modeling
author_facet David Jendryczko
Jana Scharfen
Heinz Holling
author_sort David Jendryczko
title The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach
title_short The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach
title_full The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach
title_fullStr The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach
title_full_unstemmed The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach
title_sort impact of situational test anxiety on retest effects in cognitive ability testing: a structural equation modeling approach
publisher MDPI AG
series Journal of Intelligence
issn 2079-3200
publishDate 2019-09-01
description When a cognitive ability is assessed repeatedly, test scores and ability estimates are often observed to increase across test sessions. This phenomenon is known as the retest (or practice) effect. One explanation for retest effects is that situational test anxiety interferes with a testee’s performance during earlier test sessions, thereby creating systematic measurement bias on the test items (interference hypothesis). Yet, the influence of anxiety diminishes with test repetitions. This explanation is controversial, since the presence of measurement bias during earlier measurement occasions cannot always be confirmed. It is argued that people from the lower end of the ability spectrum become aware of their deficits in test situations and therefore report higher anxiety (deficit hypothesis). In 2014, a structural equation model was proposed that specifically allows the comparison of these two hypotheses with regard to explanatory power for the negative anxiety−ability correlation found in cross-sectional assessments. We extended this model for usage in longitudinal studies to investigate the impact of test anxiety on test performance and on retest effects. A latent neighbor-change growth curve was implemented into the model that enables an estimation of retest effects between all pairs of successive test sessions. Systematic restrictions on model parameters allow testing the hypothetical reduction in anxiety interference over the test sessions, which can be compared to retest effect sizes. In an empirical study with seven measurement occasions, we found that a substantial reduction in interference upon the second test session was associated with the largest retest effect in a figural matrices test, which served as a proxy measure for general intelligence. However, smaller retest effects occurred up to the fourth test administration, whereas evidence for anxiety-induced measurement bias was only produced for the first two test sessions. Anxiety and ability were not negatively correlated at any time when the interference effects were controlled for. Implications, limitations, and suggestions for future research are discussed.
topic retest effect
practice effect
cognitive abilities
intelligence
figural matrices
test anxiety
structural equation modeling
url https://www.mdpi.com/2079-3200/7/4/22
work_keys_str_mv AT davidjendryczko theimpactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach
AT janascharfen theimpactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach
AT heinzholling theimpactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach
AT davidjendryczko impactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach
AT janascharfen impactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach
AT heinzholling impactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach
_version_ 1725143993039192064