Automated assessment using Natural Language Processing (NLP) has the potential to make English speaking assessments more reliable, authentic, and accessible. Yet without careful examination, NLP may exacerbate social prejudices based on gender or native language (L1). Current NLP-based assessments are prone to such biases, yet research and…

Development and use of validated assessments in physics provide insight into student understanding of physics concepts and can be utilized to track student learning across time and instructional strategies. These tools can be used to gauge the efficacy of interventions designed to support students and persistence, and allow instructors to make…

The number of applications to postsecondary institutions continues to increase year over year, and in most cases, the number of applications exceeds the number of students admitted. The use of standardized tests continues to grow to help in these admissions decisions. Due to both high usage rates and the changing demographics of our nation's…

Assessment is an integral part of learning as it is used to gather information about a test-taker. Those in the field of academia, such as educational policy makers, instructors, and administrators are able to use information gathered from tests to further instruction and learning decisions (Baker, 2006; Drianna, 2007; Kasper & Ross, 2013;…

The practice of grading student writing often seems arbitrary and unfair to students. It is important to students and educators that writing is fairly and accurately assessed in order to facilitate demonstrable improvement in their composition. This research addressed a specific writing rubric as a method to mitigate implicit or subconscious…

The purpose of the study is to further investigate the validity of instruments used for collecting preservice teachers' perceptions of self-efficacy adapting the three-level IRT model described in Cheong's study (2006). The focus of the present study is to investigate whether the polytomously-scored items on the preservice teachers' self-efficacy…

"Differential item functioning" (DIF) and "differential distractor functioning" (DDF) are methods used to screen for item bias (Camilli & Shepard, 1994; Penfield, 2008). Using an applied empirical example, this mixed-methods study examined the congruency and relationship of DIF and DDF methods in screening multiple-choice items. Data for Study I…

The primary object of this study was to determine whether racial and/or gender bias were evidenced in the use of the ICIS-Principal. Specifically, will the use of the ICIS-Principal result in biased scores at a statistically significant level when rating current practicing administrators of varying gender and race. The study involved simulated…

The increased use of polytomous item formats has led assessment developers to pay greater attention to the detection of differential item functioning (DIF) in these items. DIF occurs when an item performs differently for two contrasting groups of respondents (e.g., males versus females) after controlling for differences in the abilities of the…