The Effects of a Dynamic Assessment on Computerized-text Summarization

• Main Authors: Shu-hua Lee, 李淑華
• Other Authors: Pi-Hsia Hung
• Format: Others
• Language: zh-TW
• Published: 2009
• Online Access: http://ndltd.ncl.edu.tw/handle/99336876709520802569

碩士 === 國立臺南大學 === 測驗統計研究所碩士班 === 97 === Summarization is an essential ability in every learning field. To provide effective text-summarization instruction, we need clear scoring rubric to measure students’ performance. The main purpose of this study was to explore the effects of a dynamic assessment on computerized-text summarization by reading comprehension and summarization of scientific articles tests and. In the study, the feedback of online text-summarizations were taken to be instruction intervention. At the same time, the slopes obtained by hierarchical linear modeling (HLM) analysis were used to be Response to Intervention (RTI) objective indicator. The subjects were seventy one 5th graders, with 33 assigned to the control group and 41 the experimental group who took computerized dynamic assessments. The students of experimental group including 27 normal ability, 10 at-risk and 4 reading disabilities were classified by Chinese reading ability. The results indicated that the rater consistency of performance statistic were around 0.89 to 0.93. The correlation coefficients between abstract performance of the texts and students’ academic Chinese test were between 0.61 to 0.72. The Pearson correlation coefficient of the text-summarization and The correlation coefficient between text-summarization performance versus reading comprehension test and summarization of scientific articles tests are 0.38 to 0.76 and 0.41 to 0.67, separately. Students’ reading comprehension and summarization abilities can effectively improved, through the intervention of computerized text-summarization. The study further suggested the slope of text-summarization close to 0.38 as the RTI objective indicators which were used to distinguish the reading disabilities from the students who were at risk. Based on above research findings, some suggestions for designs and plans of RTI on dynamic assessment on computerized-text summarization and further studies were made.