Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


case1078243882.pdf (825.35 KB)

ETD Abstract Container

Abstract Header

The Perception of Emotions in Multimedia: An Empirical Test of Three Models of Conformance and Contest

Somsaman, Kritsachai
http://rave.ohiolink.edu/etdc/view?acc_num=case1078243882

Abstract Details

2004, Doctor of Philosophy, Case Western Reserve University, Management Information and Decision Systems.
Information Systems research usually suggests that information received from multiple modalities results in better communication. Media richness theory, for instance, suggests that one of the reasons face to face communication is better than a letter or memo is the greater number of cues and channels used. However, using auditory and visual channels to present information in multimedia does not always provide benefits. When the information from both channels represents common information, the result is a unifying perception but when the information is in conflict, the communication can become confused. This study investigates how emotional information in these two channels is perceived when audio and visual information are in a conformance condition – the emotion information of the two media are consistent in both valence and arousal dimensions—and when audio and visual information are in a contest condition—the emotion information of audio and video are on the opposite sides of both valence and arousal dimensions. A laboratory experiment was conducted with 162 students where 37 of them were from the institute of music. Participants were randomly assigned to view 3 different sets of audio, video and multimedia combinations in both conformance and contest conditions. Using the method of multiple working hypotheses, the effects of audio-visual combinations are examined in relation to three models of perception—channel dominance, integration, and individual differences. In a conformance condition, the perception of emotions follows the channel dominance model where the perception of emotions from multimedia is similar with the perception of emotions from audio stimuli. In a contest condition, the perception of emotions follows the integration model where perception of emotions from multimedia falls between those of the individual media. Comparisons between participants of different gender, cultural background, and musical expertise reveal no differences in the perception of emotions. Thus, an individual differences model is not supported here. The results suggest that the perception of emotions is adaptive to different conditions of audio-visual combination. This knowledge is useful as a basis for further investigation of information usage and as a guideline for the design of multimedia information.
Fred Collopy (Advisor)
Information Science
Multimedia; Emotions; Perception; Business Visualization; Emotions in Music

Recommended Citations

Citations

  • Somsaman, K. (2004). The Perception of Emotions in Multimedia: An Empirical Test of Three Models of Conformance and Contest [Doctoral dissertation, Case Western Reserve University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=case1078243882

    APA Style (7th edition)

  • Somsaman, Kritsachai. The Perception of Emotions in Multimedia: An Empirical Test of Three Models of Conformance and Contest. 2004. Case Western Reserve University, Doctoral dissertation. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=case1078243882.

    MLA Style (8th edition)

  • Somsaman, Kritsachai. "The Perception of Emotions in Multimedia: An Empirical Test of Three Models of Conformance and Contest." Doctoral dissertation, Case Western Reserve University, 2004. http://rave.ohiolink.edu/etdc/view?acc_num=case1078243882

    Chicago Manual of Style (17th edition)

case1078243882
1,972
© 2004, all rights reserved.
This open access ETD is published by Case Western Reserve University School of Graduate Studies and OhioLINK.