Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio

Despite attempts to improve speech recognition in noise via hearing aid algorithms, communication where there is background noise continues to present serious challenges to hearing aid users. The viability of using speech reading to augment amplification to improve communication in noise has not bee...

Full description

Bibliographic Details
Other Authors: Southard, Stuart D. (authoraut)
Format: Others
Language:English
English
Published: Florida State University
Subjects:
Online Access:http://purl.flvc.org/fsu/fd/FSU_migr_etd-1618
id ndltd-fsu.edu-oai-fsu.digital.flvc.org-fsu_176124
record_format oai_dc
spelling ndltd-fsu.edu-oai-fsu.digital.flvc.org-fsu_1761242020-06-05T03:08:20Z Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio Southard, Stuart D. (authoraut) Morris, Richard J. (professor directing dissertation) Kamata, Akihito (outside committee member) Walker, Virginia (committee member) Goldstein, Howard (committee member) Terrio, Lee (committee member) School of Communication (degree granting department) Florida State University (degree granting institution) Text text Florida State University Florida State University English eng 1 online resource computer application/pdf Despite attempts to improve speech recognition in noise via hearing aid algorithms, communication where there is background noise continues to present serious challenges to hearing aid users. The viability of using speech reading to augment amplification to improve communication in noise has not been fully investigated. One reason for this oversight is the assumption that the decline in speech recognition performance with decreases in S/N ratio is similar for communicative situations in which speech reading is available and for those in which it is not. In this study, comparison of speech recognition performance for auditory only (A) and audio-visual (AV) presentation of sentences was made at four signal-to-noise-ratios ranging from 0 to –6 dB. Twenty-six participants with normal hearing and vision, 20 to 30 years, responded to eight experimental conditions (A and AV presentation of speech at each of four signal-to-noise ratios). Speech recognition performance was evaluated using a 2 X 4 repeated measures ANOVA. The main effects of presentation mode and S/N ratio were statistically significant. More importantly, there was a significant interaction between these factors for speech recognition performance. The interaction revealed a growing benefit of speech reading, defined as the difference between audio-visual and auditory only performance (AV-A), with decreasing signal-to-noise ratios. This finding of increasing benefit with deteriorating listening conditions refutes the assumption that performance decline with increasing background noise is independent of presentation mode. This finding suggests that the need for individuals with hearing impairment to avail themselves of visual speech cues increases with a deteriorating listening environment. In view of these findings, hearing aid evaluations involving both A and AV presentation of speech at different signal-to-noise ratios are recommended. Such procedures allow for both objective and subjective assessment of speech recognition performance under combinations of presentation mode and S/N ratios. A Dissertation Submitted to the Department of Communication Disorders in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy. Fall Semester, 2003. October 31, 2003. Comparison of audio with audio-visual speech recognition Includes bibliographical references. Richard J. Morris, Professor Directing Dissertation; Akihito Kamata, Outside Committee Member; Virginia Walker, Committee Member; Howard Goldstein, Committee Member; Lee Terrio, Committee Member. Communication FSU_migr_etd-1618 http://purl.flvc.org/fsu/fd/FSU_migr_etd-1618 This Item is protected by copyright and/or related rights. You are free to use this Item in any way that is permitted by the copyright and related rights legislation that applies to your use. For other uses you need to obtain permission from the rights-holder(s). The copyright in theses and dissertations completed at Florida State University is held by the students who author them. http://diginole.lib.fsu.edu/islandora/object/fsu%3A176124/datastream/TN/view/Speechreading%27s%20Benefit%20to%20the%20Recognition%20of%20Sentences%20as%20a%20Function%20of%20Signal-to-Noise%20Ratio.jpg
collection NDLTD
language English
English
format Others
sources NDLTD
topic Communication
spellingShingle Communication
Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio
description Despite attempts to improve speech recognition in noise via hearing aid algorithms, communication where there is background noise continues to present serious challenges to hearing aid users. The viability of using speech reading to augment amplification to improve communication in noise has not been fully investigated. One reason for this oversight is the assumption that the decline in speech recognition performance with decreases in S/N ratio is similar for communicative situations in which speech reading is available and for those in which it is not. In this study, comparison of speech recognition performance for auditory only (A) and audio-visual (AV) presentation of sentences was made at four signal-to-noise-ratios ranging from 0 to –6 dB. Twenty-six participants with normal hearing and vision, 20 to 30 years, responded to eight experimental conditions (A and AV presentation of speech at each of four signal-to-noise ratios). Speech recognition performance was evaluated using a 2 X 4 repeated measures ANOVA. The main effects of presentation mode and S/N ratio were statistically significant. More importantly, there was a significant interaction between these factors for speech recognition performance. The interaction revealed a growing benefit of speech reading, defined as the difference between audio-visual and auditory only performance (AV-A), with decreasing signal-to-noise ratios. This finding of increasing benefit with deteriorating listening conditions refutes the assumption that performance decline with increasing background noise is independent of presentation mode. This finding suggests that the need for individuals with hearing impairment to avail themselves of visual speech cues increases with a deteriorating listening environment. In view of these findings, hearing aid evaluations involving both A and AV presentation of speech at different signal-to-noise ratios are recommended. Such procedures allow for both objective and subjective assessment of speech recognition performance under combinations of presentation mode and S/N ratios. === A Dissertation Submitted to the Department of Communication Disorders in Partial Fulfillment of the Requirements for the Degree of Doctor of Philosophy. === Fall Semester, 2003. === October 31, 2003. === Comparison of audio with audio-visual speech recognition === Includes bibliographical references. === Richard J. Morris, Professor Directing Dissertation; Akihito Kamata, Outside Committee Member; Virginia Walker, Committee Member; Howard Goldstein, Committee Member; Lee Terrio, Committee Member.
author2 Southard, Stuart D. (authoraut)
author_facet Southard, Stuart D. (authoraut)
title Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio
title_short Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio
title_full Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio
title_fullStr Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio
title_full_unstemmed Speechreading's Benefit to the Recognition of Sentences as a Function of Signal-to-Noise Ratio
title_sort speechreading's benefit to the recognition of sentences as a function of signal-to-noise ratio
publisher Florida State University
url http://purl.flvc.org/fsu/fd/FSU_migr_etd-1618
_version_ 1719317829487951872