The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach
When a cognitive ability is assessed repeatedly, test scores and ability estimates are often observed to increase across test sessions. This phenomenon is known as the retest (or practice) effect. One explanation for retest effects is that situational test anxiety interferes with a testee’...
Main Authors: | , , |
---|---|
Format: | Article |
Language: | English |
Published: |
MDPI AG
2019-09-01
|
Series: | Journal of Intelligence |
Subjects: | |
Online Access: | https://www.mdpi.com/2079-3200/7/4/22 |
id |
doaj-026c899e03b04f68a2849f6e3d7b819c |
---|---|
record_format |
Article |
spelling |
doaj-026c899e03b04f68a2849f6e3d7b819c2020-11-25T01:18:04ZengMDPI AGJournal of Intelligence2079-32002019-09-01742210.3390/jintelligence7040022jintelligence7040022The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling ApproachDavid Jendryczko0Jana Scharfen1Heinz Holling2Institute of Psychology, Westfälische Wilhelms-Universität Münster, 48149 Münster, GermanyInstitute of Psychology, Westfälische Wilhelms-Universität Münster, 48149 Münster, GermanyInstitute of Psychology, Westfälische Wilhelms-Universität Münster, 48149 Münster, GermanyWhen a cognitive ability is assessed repeatedly, test scores and ability estimates are often observed to increase across test sessions. This phenomenon is known as the retest (or practice) effect. One explanation for retest effects is that situational test anxiety interferes with a testee’s performance during earlier test sessions, thereby creating systematic measurement bias on the test items (interference hypothesis). Yet, the influence of anxiety diminishes with test repetitions. This explanation is controversial, since the presence of measurement bias during earlier measurement occasions cannot always be confirmed. It is argued that people from the lower end of the ability spectrum become aware of their deficits in test situations and therefore report higher anxiety (deficit hypothesis). In 2014, a structural equation model was proposed that specifically allows the comparison of these two hypotheses with regard to explanatory power for the negative anxiety−ability correlation found in cross-sectional assessments. We extended this model for usage in longitudinal studies to investigate the impact of test anxiety on test performance and on retest effects. A latent neighbor-change growth curve was implemented into the model that enables an estimation of retest effects between all pairs of successive test sessions. Systematic restrictions on model parameters allow testing the hypothetical reduction in anxiety interference over the test sessions, which can be compared to retest effect sizes. In an empirical study with seven measurement occasions, we found that a substantial reduction in interference upon the second test session was associated with the largest retest effect in a figural matrices test, which served as a proxy measure for general intelligence. However, smaller retest effects occurred up to the fourth test administration, whereas evidence for anxiety-induced measurement bias was only produced for the first two test sessions. Anxiety and ability were not negatively correlated at any time when the interference effects were controlled for. Implications, limitations, and suggestions for future research are discussed.https://www.mdpi.com/2079-3200/7/4/22retest effectpractice effectcognitive abilitiesintelligencefigural matricestest anxietystructural equation modeling |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
David Jendryczko Jana Scharfen Heinz Holling |
spellingShingle |
David Jendryczko Jana Scharfen Heinz Holling The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach Journal of Intelligence retest effect practice effect cognitive abilities intelligence figural matrices test anxiety structural equation modeling |
author_facet |
David Jendryczko Jana Scharfen Heinz Holling |
author_sort |
David Jendryczko |
title |
The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach |
title_short |
The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach |
title_full |
The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach |
title_fullStr |
The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach |
title_full_unstemmed |
The Impact of Situational Test Anxiety on Retest Effects in Cognitive Ability Testing: A Structural Equation Modeling Approach |
title_sort |
impact of situational test anxiety on retest effects in cognitive ability testing: a structural equation modeling approach |
publisher |
MDPI AG |
series |
Journal of Intelligence |
issn |
2079-3200 |
publishDate |
2019-09-01 |
description |
When a cognitive ability is assessed repeatedly, test scores and ability estimates are often observed to increase across test sessions. This phenomenon is known as the retest (or practice) effect. One explanation for retest effects is that situational test anxiety interferes with a testee’s performance during earlier test sessions, thereby creating systematic measurement bias on the test items (interference hypothesis). Yet, the influence of anxiety diminishes with test repetitions. This explanation is controversial, since the presence of measurement bias during earlier measurement occasions cannot always be confirmed. It is argued that people from the lower end of the ability spectrum become aware of their deficits in test situations and therefore report higher anxiety (deficit hypothesis). In 2014, a structural equation model was proposed that specifically allows the comparison of these two hypotheses with regard to explanatory power for the negative anxiety−ability correlation found in cross-sectional assessments. We extended this model for usage in longitudinal studies to investigate the impact of test anxiety on test performance and on retest effects. A latent neighbor-change growth curve was implemented into the model that enables an estimation of retest effects between all pairs of successive test sessions. Systematic restrictions on model parameters allow testing the hypothetical reduction in anxiety interference over the test sessions, which can be compared to retest effect sizes. In an empirical study with seven measurement occasions, we found that a substantial reduction in interference upon the second test session was associated with the largest retest effect in a figural matrices test, which served as a proxy measure for general intelligence. However, smaller retest effects occurred up to the fourth test administration, whereas evidence for anxiety-induced measurement bias was only produced for the first two test sessions. Anxiety and ability were not negatively correlated at any time when the interference effects were controlled for. Implications, limitations, and suggestions for future research are discussed. |
topic |
retest effect practice effect cognitive abilities intelligence figural matrices test anxiety structural equation modeling |
url |
https://www.mdpi.com/2079-3200/7/4/22 |
work_keys_str_mv |
AT davidjendryczko theimpactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach AT janascharfen theimpactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach AT heinzholling theimpactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach AT davidjendryczko impactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach AT janascharfen impactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach AT heinzholling impactofsituationaltestanxietyonretesteffectsincognitiveabilitytestingastructuralequationmodelingapproach |
_version_ |
1725143993039192064 |