Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio

• Other Authors: Southard, Stuart D. (authoraut)
• Format: Others
• Language: English; English
• Published: Florida State University
• Subjects: Communication
• Online Access: http://purl.flvc.org/fsu/fd/FSU_migr_etd-1618

Despite attempts to improve speech recognition in noise via hearing aid algorithms, communication where there is background noise continues to present serious challenges to hearing aid users. The viability of using speech reading to augment amplification to improve communication in noise has not been fully investigated. One reason for this oversight is the assumption that the decline in speech recognition performance with decreases in S/N ratio is similar for communicative situations in which speech reading is available and for those in which it is not. In this study, comparison of speech recognition performance for auditory only (A) and audio-visual (AV) presentation of sentences was made at four signal-to-noise-ratios ranging from 0 to –6 dB. Twenty-six participants with normal hearing and vision, 20 to 30 years, responded to eight experimental conditions (A and AV presentation of speech at each of four signal-to-noise ratios). Speech recognition performance was evaluated using a 2 X 4 repeated measures ANOVA. The main effects of presentation mode and S/N ratio were statistically significant. More importantly, there was a significant interaction between these factors for speech recognition performance. The interaction revealed a growing benefit of speech reading, defined as the difference between audio-visual and auditory only performance (AV-A), with decreasing signal-to-noise ratios. This finding of increasing benefit with deteriorating listening conditions refutes the assumption that performance decline with increasing background noise is independent of presentation mode. This finding suggests that the need for individuals with hearing impairment to avail themselves of visual speech cues increases with a deteriorating listening environment. In view of these findings, hearing aid evaluations involving both A and AV presentation of speech at different signal-to-noise ratios are recommended. Such procedures allow for both objective and subjective assessment of speech recognition performance under combinations of presentation mode and S/N ratios. === A Dissertation Submitted to the Department of Communication Disorders in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy. === Fall Semester, 2003. === October 31, 2003. === Comparison of audio with audio-visual speech recognition === Includes bibliographical references. === Richard J. Morris, Professor Directing Dissertation; Akihito Kamata, Outside Committee Member; Virginia Walker, Committee Member; Howard Goldstein, Committee Member; Lee Terrio, Committee Member.