Visual and Temporal Influences on Multimodal Speech Integration

Visual and Temporal Influences on Multimodal Speech Integration

Bibliographic Details
Main Author: Shatzer, Hannah Elizabeth
Language:English
Published: The Ohio State University / OhioLINK 2015
Subjects:
Psychology
audiovisual speech
integration
visual informativeness
duration
onset asynchrony
Online Access:http://rave.ohiolink.edu/etdc/view?acc_num=osu1437403560
id ndltd-OhioLink-oai-etd.ohiolink.edu-osu1437403560
record_format oai_dc
spelling ndltd-OhioLink-oai-etd.ohiolink.edu-osu14374035602021-08-03T06:32:07Z Visual and Temporal Influences on Multimodal Speech Integration Shatzer, Hannah Elizabeth Psychology audiovisual speech integration visual informativeness duration onset asynchrony Auditory and visual speech cues are often used in tandem to maximize understanding of a speech signal when communicating. A neural model by Bhat et al. (2015) posits that the increasing informativeness of the visual speech signal induces reweighting of auditory processing from low-level to high-level auditory networks to better integrate auditory and visual speech into a single percept. The current study tested this claim by measuring perceivers’ tolerance of audiovisual onset asynchrony (AVOA) for CV syllables, predicting that increased visual salience will increase AVOA tolerance by inducing the reweighting towards higher-level networks and increasing cohesion. An adaptive AVOA paradigm estimated the threshold of asynchrony tolerance for each CV in Experiment 1, finding that as visual salience of the CV increased, the AVOA threshold instead decreased—the opposite of Bhat et al.’s model predictions. Results also suggested that articulatory duration may predict AVOA thresholds, so experiments 2a and 2b were conducted to probe this finding by manipulating duration both artificially and naturally. Both experiments revealed that as CV duration increased, AVOA thresholds increased. Results suggest that the reweighting hypothesis is not supported for visual informativeness, and alternate explanations must be considered. 2015-09-03 English text The Ohio State University / OhioLINK http://rave.ohiolink.edu/etdc/view?acc_num=osu1437403560 http://rave.ohiolink.edu/etdc/view?acc_num=osu1437403560 unrestricted This thesis or dissertation is protected by copyright: all rights reserved. It may not be copied or redistributed beyond the terms of applicable copyright laws.
collection NDLTD
language English
sources NDLTD
topic Psychology
audiovisual speech
integration
visual informativeness
duration
onset asynchrony
spellingShingle Psychology
audiovisual speech
integration
visual informativeness
duration
onset asynchrony
Shatzer, Hannah Elizabeth
Visual and Temporal Influences on Multimodal Speech Integration
author Shatzer, Hannah Elizabeth
author_facet Shatzer, Hannah Elizabeth
author_sort Shatzer, Hannah Elizabeth
title Visual and Temporal Influences on Multimodal Speech Integration
title_short Visual and Temporal Influences on Multimodal Speech Integration
title_full Visual and Temporal Influences on Multimodal Speech Integration
title_fullStr Visual and Temporal Influences on Multimodal Speech Integration
title_full_unstemmed Visual and Temporal Influences on Multimodal Speech Integration
title_sort visual and temporal influences on multimodal speech integration
publisher The Ohio State University / OhioLINK
publishDate 2015
url http://rave.ohiolink.edu/etdc/view?acc_num=osu1437403560
work_keys_str_mv AT shatzerhannahelizabeth visualandtemporalinfluencesonmultimodalspeechintegration
_version_ 1719438686360174592

Similar Items