Skip to Main Content
 

Global Search Box

 
 
 

ETD Abstract Container

Abstract Header

A Comparison of a Traditional Ranking Format to a Drag-and-Drop Format with Stacking

Timbrook, Jerry P.

Abstract Details

2013, Master of Arts (M.A.), University of Dayton, Psychology, General.
This study investigated the differences between a modified version of the traditional ranking format (MTF) and a novel ranking format called the BINS format. The BINS format utilizes drag-and-drop technology to rank alternatives, allows respondents to indicate distance between ranks, and also allows respondents to assign ties to the same alternatives. Seventy-two participants completed two ranking tasks: a ranking of items from the Rokeach Value Survey – Form D (RVS) and a ranking of aspects according to how important they were in a participant’s decision to attend the University of Dayton (UD). Participants used the MTF to complete one ranking task, and the BINS format for the other. Four variables were examined for each ranking format: Completion Time (as recorded by a computer control system and as self-reported by participants), Usability on the System Usability Scale (SUS), Format Preference, and Number of Repositionings (as recorded by a computer control system and as self-reported by participants). Participants completed the RVS ranking task more quickly using the MTF when compared to the BINS format. There were no significant differences in completion time when participants ranked aspects related to UD. However, for both the RVS and aspects related to UD, significantly more participants self-reported that the BINS format allowed them to complete their ranking task faster than the MTF. Participants rated the BINS format as significantly more usable than the MTF. The majority of participants (78%) preferred to use the BINS format more than the MTF. Participants reported repositioning alternatives (ranking an alternative and then re-ranking the same alternative) significantly more often using the BINS format than the MTF. There was not a significant difference in actual repositionings between the MTF and the BINS format as reported by the computer control system. Overall, the results of this study established that the BINS format is a clear improvement over the MTF. The BINS format outperformed the MTF on measures of usability, preference, and reported number of repositionings. Furthermore, the BINS format reduces respondent burden by displaying an ordered list of ranked alternatives throughout a ranking task. By capturing information on the distance between ranks and by permitting ties between alternatives, the BINS format allows researchers to collect rich ranking data that is also compatible with factor analytic techniques. These unique features of the BINS format make it an ideal tool for implementation in the field of electronic survey research.
William Moroney, Ph.D. (Advisor)
Susan Davis, Ph.D. (Committee Member)
David Biers, Ph.D. (Committee Member)
128 p.

Recommended Citations

Citations

  • Timbrook, J. P. (2013). A Comparison of a Traditional Ranking Format to a Drag-and-Drop Format with Stacking [Master's thesis, University of Dayton]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=dayton1367241685

    APA Style (7th edition)

  • Timbrook, Jerry. A Comparison of a Traditional Ranking Format to a Drag-and-Drop Format with Stacking. 2013. University of Dayton, Master's thesis. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=dayton1367241685.

    MLA Style (8th edition)

  • Timbrook, Jerry. "A Comparison of a Traditional Ranking Format to a Drag-and-Drop Format with Stacking." Master's thesis, University of Dayton, 2013. http://rave.ohiolink.edu/etdc/view?acc_num=dayton1367241685

    Chicago Manual of Style (17th edition)