Skip to Main Content
 

Global Search Box

 
 
 
 

Files

File List


v2_Dissertation_Susan_Mauck.pdf (4.36 MB)

ETD Abstract Container

Abstract Header

The Development of the Fundamental Concepts in Applied Statistics Test and Validation of Its Use

Mauck, Susan Anderson
http://orcid.org/0000-0002-7212-8500
http://rave.ohiolink.edu/etdc/view?acc_num=osu1555451094373399

Abstract Details

2019, Doctor of Philosophy, Ohio State University, Educational Studies.
This dissertation study describes the development of an instrument, the Fundamental Concepts in Applied Statistics Test (FCAST), which will serve as a tool for graduate students, their advisors, and instructors of applied quantitative methods courses. Most doctoral programs in the social and behavioral sciences include the requirement that students take two or more quantitative methods courses to prepare them to conduct original research and to evaluate the quantitative research of others. For most of these courses, it is assumed that students have basic knowledge of statistical concepts and key terms. Students may not, however, even if an introduction to statistics course is a prerequisite. Those who begin a quantitative methods course without sufficient background knowledge may struggle to achieve the objectives of the course or may become frustrated when presented with statistical concepts or key terms with which they are unfamiliar. The FCAST was designed to be used as a self-assessment by graduate students who wish to measure the degree to which they understand fundamental concepts in applied statistics, or by their faculty advisors to support sound decision-making in developing students’ course plans, and as a formative assessment by instructors of quantitative methods courses who wish to gather evidence of their students’ background knowledge to guide instruction. The interpretations and uses of the FCAST were validated using Kane’s argument-based approach to validation through a systematic, test-development process. Subject-matter experts (SME) and examination of textbooks and course descriptions determined the content of the test. These data were used to write test items which were iteratively reviewed by SME for accuracy and adherence to the purposes of the test, and by graduate student users (Users) for clarity and fairness until a pool of items were pilot tested with a small sample of graduate students (n = 31). Data from the small-sample pilot test were analyzed to compute item statistics [e.g., means (SD)] and patterns across score groups. These statistics and SME and User reviews were used to select items for a pilot test that was administered to a larger sample (n = 412). Data from the large-sample pilot test were examined using parallel analysis, exploratory factor analysis, and methods from classical test theory and item response theory. Graduate students in the social and behavioral sciences have a broad range of pre-existing quantitative knowledge and skills which impact how they interpret and organize their research. They need a way to measure their basic statistical competence. Instructors of quantitative methods need a way to measure the quantitative background knowledge of their students. The Fundamental Concepts in Applied Statistics Test (FCAST) can serve these purposes. Because quantitative research methodology coursework is required by many graduate programs in the social and behavioral sciences, a test of fundamental applied statistics knowledge provides a useful tool for graduate students and faculty.
Richard Lomax (Advisor)
Ann O'Connell (Advisor)
Dorinda Gallant (Committee Member)
331 p.
Education; Educational Tests and Measurements; Statistics
Graduate student education, social and behavioral sciences, formative assessment, self-assessment, validity study, Kane argument-based approach, applied statistics, quantitative methods, IRT, EFA, measurement, validity

Recommended Citations

Citations

  • Mauck, S. A. (2019). The Development of the Fundamental Concepts in Applied Statistics Test and Validation of Its Use [Doctoral dissertation, Ohio State University]. OhioLINK Electronic Theses and Dissertations Center. http://rave.ohiolink.edu/etdc/view?acc_num=osu1555451094373399

    APA Style (7th edition)

  • Mauck, Susan. The Development of the Fundamental Concepts in Applied Statistics Test and Validation of Its Use . 2019. Ohio State University, Doctoral dissertation. OhioLINK Electronic Theses and Dissertations Center, http://rave.ohiolink.edu/etdc/view?acc_num=osu1555451094373399.

    MLA Style (8th edition)

  • Mauck, Susan. "The Development of the Fundamental Concepts in Applied Statistics Test and Validation of Its Use ." Doctoral dissertation, Ohio State University, 2019. http://rave.ohiolink.edu/etdc/view?acc_num=osu1555451094373399

    Chicago Manual of Style (17th edition)

osu1555451094373399
682
© 2019, all rights reserved.
This open access ETD is published by The Ohio State University and OhioLINK.