Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


Shatzer_mastersthesis_final.pdf (630.33 KB)

ETD Abstract Container

Abstract Header

Visual and Temporal Influences on Multimodal Speech Integration

Shatzer, Hannah Elizabeth
http://rave.ohiolink.edu/etdc/view?acc_num=osu1437403560

Abstract Details

2015, Master of Arts, Ohio State University, Psychology.
Auditory and visual speech cues are often used in tandem to maximize understanding of a speech signal when communicating. A neural model by Bhat et al. (2015) posits that the increasing informativeness of the visual speech signal induces reweighting of auditory processing from low-level to high-level auditory networks to better integrate auditory and visual speech into a single percept. The current study tested this claim by measuring perceivers’ tolerance of audiovisual onset asynchrony (AVOA) for CV syllables, predicting that increased visual salience will increase AVOA tolerance by inducing the reweighting towards higher-level networks and increasing cohesion. An adaptive AVOA paradigm estimated the threshold of asynchrony tolerance for each CV in Experiment 1, finding that as visual salience of the CV increased, the AVOA threshold instead decreased—the opposite of Bhat et al.’s model predictions. Results also suggested that articulatory duration may predict AVOA thresholds, so experiments 2a and 2b were conducted to probe this finding by manipulating duration both artificially and naturally. Both experiments revealed that as CV duration increased, AVOA thresholds increased. Results suggest that the reweighting hypothesis is not supported for visual informativeness, and alternate explanations must be considered.
Mark Pitt, PhD (Advisor)
Cynthia Clopper, PhD (Committee Member)
Julie Golomb, PhD (Committee Member)
Antoine Shahin, PhD (Committee Member)
74 p.
Psychology
audiovisual speech; integration; visual informativeness; duration; onset asynchrony

Recommended Citations

Citations

  • Shatzer, H. E. (2015). Visual and Temporal Influences on Multimodal Speech Integration [Master's thesis, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu1437403560

    APA Style (7th edition)

  • Shatzer, Hannah. Visual and Temporal Influences on Multimodal Speech Integration. 2015. Ohio State University, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=osu1437403560.

    MLA Style (8th edition)

  • Shatzer, Hannah. "Visual and Temporal Influences on Multimodal Speech Integration." Master's thesis, Ohio State University, 2015. http://rave.ohiolink.edu/etdc/view?acc_num=osu1437403560

    Chicago Manual of Style (17th edition)

osu1437403560
393
© 2015, all rights reserved.
This open access ETD is published by The Ohio State University and OhioLINK.