Skip to Main Content
 

Global Search Box

 
 
 
 

ETD Abstract Container

Abstract Header

Estimating Performance Mean and Variability With Distributional Rating Scales: A Field Study Towards Improved Performance Measurement

Colatat, Mahyulee C.

Abstract Details

2008, Doctor of Philosophy (Ph.D.), Bowling Green State University, Psychology/Industrial-Organizational.
Research on distributional rating scales is mixed on whether they represent an improvement in performance measurement over traditional Likert-type scales. The present study attempted to reconcile the mixed results by suggesting that distributional ratings provide estimates of mean performance comparable to Likert-type ratings, yet also contribute conceptually critical estimates of performance variability unavailable from Likert-type ratings. Approximately 2,090 undergraduate students in 95 classes rated their instructors' performance. Data were collected in a between-classes design with random assignment to either distributional or Likert-type rating scale conditions. Results indicated no significant differences in estimates of mean performance or interrater agreement for mean performance between distributional and Likert-type rating scales. Further, raters used the distributional scale to report some degree of performance variability, and surprisingly, they agreed on variability estimates as much as or more than they agreed on mean estimates. Thus, distributional rating scales indeed have the potential to capture richer performance information than Likert-type scales.
Milton D. Hakel, PhD (Committee Chair)
Michael J. Zickar, PhD (Committee Member)
Dara Musher-Eizenman, PhD (Committee Member)
Michael C. Carroll, PhD (Committee Member)
59 p.

Recommended Citations

Citations

  • Colatat, M. C. (2008). Estimating Performance Mean and Variability With Distributional Rating Scales: A Field Study Towards Improved Performance Measurement [Doctoral dissertation, Bowling Green State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu1206385486

    APA Style (7th edition)

  • Colatat, Mahyulee. Estimating Performance Mean and Variability With Distributional Rating Scales: A Field Study Towards Improved Performance Measurement. 2008. Bowling Green State University, Doctoral dissertation. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=bgsu1206385486.

    MLA Style (8th edition)

  • Colatat, Mahyulee. "Estimating Performance Mean and Variability With Distributional Rating Scales: A Field Study Towards Improved Performance Measurement." Doctoral dissertation, Bowling Green State University, 2008. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu1206385486

    Chicago Manual of Style (17th edition)