Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


ron final.pdf (2.78 MB)

ETD Abstract Container

Abstract Header

Bringing Situational Judgement Tests to the 21st Century: Scoring of Situational Judgement Tests Using Item Response Theory

Ron, Tom Haim
http://rave.ohiolink.edu/etdc/view?acc_num=bgsu157146239865009

Abstract Details

2019, Doctor of Philosophy (Ph.D.), Bowling Green State University, Psychology/Industrial-Organizational.
Situational judgement tests (SJTs) became popular selection instruments in the last three decades, due to their predictive validity, small subgroup differences, and high face validity. However, although SJTs have made a significant progress in the last century, there still remains a construct problem – it is not sure whether SJTs are a construct or a measurement method. In addition, almost in parallel to the advancement of SJTs, a new theory for scoring and testing has been developed – item response theory (IRT). IRT offers researchers and practitioners flexible models that fit various types of data and can be used to score tests and questionnaires and to learn about their psychometric qualities. In addition, some IRT models offer us a unique method to score multidimensional tests, which assess more than one construct. This study attempts to apply different IRT models to a leadership SJT in order to answer two main questions: one, is SJT a construct or a measurement method? And two, can IRT-based scoring benefit us in terms of validity and reducing subgroup differences over the classical scoring approaches? These questions were tested on three samples of Israeli soldiers who went through a selection process for officers’ training school and had to take a leadership SJT as part of it. The results of this study suggest that the picture is more complicated than it was originally thought. It appears that IRT has value over classical test theory (CTT) only for some samples, whereas CTT has more value in other samples. In regard to the construct vs. measurement method debate, it appears that multidimensional IRT models better fit the SJT that was used in this study, a testimony that sides with the SJT as a measurement method camp. Future research and limitations are discussed at the end of the manuscript.
Michael Zickar, Dr. (Advisor)
Hyeyoung Bang, Dr. (Other)
Joshua Grubbs, Dr. (Committee Member)
Samuel McAbee, Dr. (Committee Member)
86 p.
Psychological Tests; Psychology
Item Response Theory; Multidimensional Item Response Theory; Situational Judgement Tests; Psychometrics

Recommended Citations

Citations

  • Ron, T. H. (2019). Bringing Situational Judgement Tests to the 21st Century: Scoring of Situational Judgement Tests Using Item Response Theory [Doctoral dissertation, Bowling Green State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu157146239865009

    APA Style (7th edition)

  • Ron, Tom. Bringing Situational Judgement Tests to the 21st Century: Scoring of Situational Judgement Tests Using Item Response Theory. 2019. Bowling Green State University, Doctoral dissertation. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=bgsu157146239865009.

    MLA Style (8th edition)

  • Ron, Tom. "Bringing Situational Judgement Tests to the 21st Century: Scoring of Situational Judgement Tests Using Item Response Theory." Doctoral dissertation, Bowling Green State University, 2019. http://rave.ohiolink.edu/etdc/view?acc_num=bgsu157146239865009

    Chicago Manual of Style (17th edition)

bgsu157146239865009
1,642
© 2019, all rights reserved.
This open access ETD is published by Bowling Green State University and OhioLINK.