The contribution of retell to the identification of struggling adolescent readers

This measurement study examined the construct validity of the retell component of the Texas Middle School Fluency Assessment (Texas Education Agency, University of Houston, & The University of Texas System, 2008a) within a confirmatory factor analysis framework. The role of retell, provided afte...

Full description

Bibliographic Details
Main Author: Reed, Deborah Kay
Format: Others
Language:English
Published: 2010
Subjects:
Online Access:http://hdl.handle.net/2152/ETD-UT-2010-05-736
id ndltd-UTEXAS-oai-repositories.lib.utexas.edu-2152-ETD-UT-2010-05-736
record_format oai_dc
spelling ndltd-UTEXAS-oai-repositories.lib.utexas.edu-2152-ETD-UT-2010-05-7362015-09-20T16:54:31ZThe contribution of retell to the identification of struggling adolescent readersReed, Deborah KayConfirmatory factor analysisReading comprehensionAdolescentsReading assessmentThis measurement study examined the construct validity of the retell component of the Texas Middle School Fluency Assessment (Texas Education Agency, University of Houston, & The University of Texas System, 2008a) within a confirmatory factor analysis framework. The role of retell, provided after a one-minute oral reading fluency measure, was investigated by comparing the fit of a three-factor model of reading competence to the data collected on a diverse sample of seventh- and eighth-grade students (N=394). The final model demonstrated adequate to mediocre fit (χ2 = 97.316 {32}; CFI = 0.958; TLI = 0.941; RMSEA = .081). Results suggest that retell was a significant contributor to comprehension (Δχ2=16.652{1}, p < .001), fluency (Δχ2=10.882{1}, p = .001), and word identification (Δχ2=7.84{1}, p = .005). However, the χ2 difference was greater for comprehension, as was the factor loading for comprehension (.250, p < .001) compared to fluency (.194, p < .001) and word identification .167, p < .001). Retell did, however, have a large residual variance (.938), suggesting it did not function well as a measure of comprehension in its current state with low inter-rater reliability (K = .37). Narrative retell scores (.352, p< .001) were better predictors of comprehension than expository retell scores (from .2221 to .264, p < .001) or the combination of all three scores (Δχ2=134.261{19}; p < .001), but average retell scores produced a more parsimonious model than narrative retell scores alone (ΔAIC = 58.275; ΔBIC = 58.275). Average retell was only weakly correlated to other measures of comprehension (from r = .155 to r = .257, p < .01). However, the relationship was stronger than the relationship between retell and other measures of fluency (from r = .158 to r = .183, p < .01) or word identification (r = .132, p < .05). In addition, retell did not demonstrate differential item functioning when student characteristics (e.g., primary language, socioeconomic status, ability level) were entered as covariates, even though there were overall latent differences.text2010-09-01T14:10:26Z2010-09-01T14:10:34Z2010-09-01T14:10:26Z2010-09-01T14:10:34Z2010-052010-09-01May 20102010-09-01T14:10:34Zthesisapplication/pdfhttp://hdl.handle.net/2152/ETD-UT-2010-05-736eng
collection NDLTD
language English
format Others
sources NDLTD
topic Confirmatory factor analysis
Reading comprehension
Adolescents
Reading assessment
spellingShingle Confirmatory factor analysis
Reading comprehension
Adolescents
Reading assessment
Reed, Deborah Kay
The contribution of retell to the identification of struggling adolescent readers
description This measurement study examined the construct validity of the retell component of the Texas Middle School Fluency Assessment (Texas Education Agency, University of Houston, & The University of Texas System, 2008a) within a confirmatory factor analysis framework. The role of retell, provided after a one-minute oral reading fluency measure, was investigated by comparing the fit of a three-factor model of reading competence to the data collected on a diverse sample of seventh- and eighth-grade students (N=394). The final model demonstrated adequate to mediocre fit (χ2 = 97.316 {32}; CFI = 0.958; TLI = 0.941; RMSEA = .081). Results suggest that retell was a significant contributor to comprehension (Δχ2=16.652{1}, p < .001), fluency (Δχ2=10.882{1}, p = .001), and word identification (Δχ2=7.84{1}, p = .005). However, the χ2 difference was greater for comprehension, as was the factor loading for comprehension (.250, p < .001) compared to fluency (.194, p < .001) and word identification .167, p < .001). Retell did, however, have a large residual variance (.938), suggesting it did not function well as a measure of comprehension in its current state with low inter-rater reliability (K = .37). Narrative retell scores (.352, p< .001) were better predictors of comprehension than expository retell scores (from .2221 to .264, p < .001) or the combination of all three scores (Δχ2=134.261{19}; p < .001), but average retell scores produced a more parsimonious model than narrative retell scores alone (ΔAIC = 58.275; ΔBIC = 58.275). Average retell was only weakly correlated to other measures of comprehension (from r = .155 to r = .257, p < .01). However, the relationship was stronger than the relationship between retell and other measures of fluency (from r = .158 to r = .183, p < .01) or word identification (r = .132, p < .05). In addition, retell did not demonstrate differential item functioning when student characteristics (e.g., primary language, socioeconomic status, ability level) were entered as covariates, even though there were overall latent differences. === text
author Reed, Deborah Kay
author_facet Reed, Deborah Kay
author_sort Reed, Deborah Kay
title The contribution of retell to the identification of struggling adolescent readers
title_short The contribution of retell to the identification of struggling adolescent readers
title_full The contribution of retell to the identification of struggling adolescent readers
title_fullStr The contribution of retell to the identification of struggling adolescent readers
title_full_unstemmed The contribution of retell to the identification of struggling adolescent readers
title_sort contribution of retell to the identification of struggling adolescent readers
publishDate 2010
url http://hdl.handle.net/2152/ETD-UT-2010-05-736
work_keys_str_mv AT reeddeborahkay thecontributionofretelltotheidentificationofstrugglingadolescentreaders
AT reeddeborahkay contributionofretelltotheidentificationofstrugglingadolescentreaders
_version_ 1716821070068056064