Audiovisual Interaction: A Case of Time Perception
博士 === 國立臺灣大學 === 心理學研究所 === 99 === We focus on time perception to test two approaches about multisensory perception. The modality appropriateness hypothesis states that audition determines the temporal judgment of audiovisual stimuli whereas the maximum likelihood estimation (MLE) model proposes an...
Main Authors: | , |
---|---|
Other Authors: | |
Format: | Others |
Language: | en_US |
Published: |
2011
|
Online Access: | http://ndltd.ncl.edu.tw/handle/91209084086608681134 |
id |
ndltd-TW-099NTU05071006 |
---|---|
record_format |
oai_dc |
spelling |
ndltd-TW-099NTU050710062015-10-28T04:07:30Z http://ndltd.ncl.edu.tw/handle/91209084086608681134 Audiovisual Interaction: A Case of Time Perception 視聽互動機制:以時間知覺為例 Kuan-Ming Chen 陳冠銘 博士 國立臺灣大學 心理學研究所 99 We focus on time perception to test two approaches about multisensory perception. The modality appropriateness hypothesis states that audition determines the temporal judgment of audiovisual stimuli whereas the maximum likelihood estimation (MLE) model proposes an optimal cue-combination so that visual and auditory signals are integrated based on the weighting scheme that is proportional to the estimate reliability of a signal. In Experiment 1 observers compared the duration between two intervals based on the common modality. The standard stimulus was presented in visual or auditory modality, and the comparison stimulus was presented in visual, auditory, or both modalities. The results support the modality appropriateness hypothesis in that the sound expanded the perceived visual duration whereas the disk did not affect the perceived auditory duration. In Experiment 2 the standard stimulus was set in different durations, and the sound effect on the perceived visual duration was observed only at the intermediate four durations whereas the disk did not affect the perceived auditory duration at all. In Experiment 3 when both the standard and comparison stimuli were presented bimodally, only with the longest duration the bimodal performance was predictable from unimodal performances according to the MLE model. In Experiment 4 the auditory signal was manipulated into different extents of reliability. The contribution of auditory modality to the bimodal estimate was greater than the visual modality, and the prediction of the MLE model only applied to the condition with less reliable auditory signal. In Experiment 5 a looming disk was used to make vision more temporally related. The results showed that visual modality can determine the bimodal judgment. Across five experiments an auditory bias in bimodal time perception was observed. However, with higher reliability of the auditory signal or more temporally related visual signal, the prior auditory bias declined and more contribution of visual signal came into effect. In conclusion, neither the modality appropriateness hypothesis nor the MLE model can explain our results, and a hybrid model was proposed: The auditory bias acts as a prior assumption held by observers in time perception to combine sensory signals, and the signals integrate based on the weighting scheme according to the reliability of signals. Su-Ling Yeh 葉素玲 2011 學位論文 ; thesis 171 en_US |
collection |
NDLTD |
language |
en_US |
format |
Others
|
sources |
NDLTD |
description |
博士 === 國立臺灣大學 === 心理學研究所 === 99 === We focus on time perception to test two approaches about multisensory perception. The modality appropriateness hypothesis states that audition determines the temporal judgment of audiovisual stimuli whereas the maximum likelihood estimation (MLE) model proposes an optimal cue-combination so that visual and auditory signals are integrated based on the weighting scheme that is proportional to the estimate reliability of a signal. In Experiment 1 observers compared the duration between two intervals based on the common modality. The standard stimulus was presented in visual or auditory modality, and the comparison stimulus was presented in visual, auditory, or both modalities. The results support the modality appropriateness hypothesis in that the sound expanded the perceived visual duration whereas the disk did not affect the perceived auditory duration. In Experiment 2 the standard stimulus was set in different durations, and the sound effect on the perceived visual duration was observed only at the intermediate four durations whereas the disk did not affect the perceived auditory duration at all. In Experiment 3 when both the standard and comparison stimuli were presented bimodally, only with the longest duration the bimodal performance was predictable from unimodal performances according to the MLE model. In Experiment 4 the auditory signal was manipulated into different extents of reliability. The contribution of auditory modality to the bimodal estimate was greater than the visual modality, and the prediction of the MLE model only applied to the condition with less reliable auditory signal. In Experiment 5 a looming disk was used to make vision more temporally related. The results showed that visual modality can determine the bimodal judgment. Across five experiments an auditory bias in bimodal time perception was observed. However, with higher reliability of the auditory signal or more temporally related visual signal, the prior auditory bias declined and more contribution of visual signal came into effect. In conclusion, neither the modality appropriateness hypothesis nor the MLE model can explain our results, and a hybrid model was proposed: The auditory bias acts as a prior assumption held by observers in time perception to combine sensory signals, and the signals integrate based on the weighting scheme according to the reliability of signals.
|
author2 |
Su-Ling Yeh |
author_facet |
Su-Ling Yeh Kuan-Ming Chen 陳冠銘 |
author |
Kuan-Ming Chen 陳冠銘 |
spellingShingle |
Kuan-Ming Chen 陳冠銘 Audiovisual Interaction: A Case of Time Perception |
author_sort |
Kuan-Ming Chen |
title |
Audiovisual Interaction: A Case of Time Perception |
title_short |
Audiovisual Interaction: A Case of Time Perception |
title_full |
Audiovisual Interaction: A Case of Time Perception |
title_fullStr |
Audiovisual Interaction: A Case of Time Perception |
title_full_unstemmed |
Audiovisual Interaction: A Case of Time Perception |
title_sort |
audiovisual interaction: a case of time perception |
publishDate |
2011 |
url |
http://ndltd.ncl.edu.tw/handle/91209084086608681134 |
work_keys_str_mv |
AT kuanmingchen audiovisualinteractionacaseoftimeperception AT chénguānmíng audiovisualinteractionacaseoftimeperception AT kuanmingchen shìtīnghùdòngjīzhìyǐshíjiānzhījuéwèilì AT chénguānmíng shìtīnghùdòngjīzhìyǐshíjiānzhījuéwèilì |
_version_ |
1718113992947269632 |