Hierarchical Linear Modeling against the Gold Standard of Visual Analysis in Single-Subject Design

Visual analysis is the Gold Standard for single-subject data because of two assumptions: a low Type I error rate and consistency across raters. However, research has shown it less reliable and accurate than desired. Autocorrelation, variability, trend, lack of obvious mean shift, and differences in...

Full description

Bibliographic Details
Main Author: Godbold, Elizabeth S
Other Authors: Frank M. Gresham
Format: Others
Language:en
Published: LSU 2008
Subjects:
Online Access:http://etd.lsu.edu/docs/available/etd-02242008-205541/
Description
Summary:Visual analysis is the Gold Standard for single-subject data because of two assumptions: a low Type I error rate and consistency across raters. However, research has shown it less reliable and accurate than desired. Autocorrelation, variability, trend, lack of obvious mean shift, and differences in the physical presentation of graphs contribute to inconsistencies and higher error rates. Statistical analysis has been advocated as a judgmental aid to visual analysis, but an appropriate statistic has not been found. In the present study, the accuracy of Hierarchical Linear Modeling was compared to raters visual analysis of previously published data using Receiver Operating Characteristic curves. The statistic was established as a potentially useful judgmental aid; however, definite conclusions were hindered by low power.