Large-scale educational assessments are sometimes considered low-stakes, increasing the possibility of confounding true performance level with low motivation. These concerns are amplified in remote testing conditions. To remove the effects of low effort levels in responses observed in remote low-stakes testing, several motivation filtering methods…

This dissertation was designed to provide current information on the job satisfaction and organizational commitment of those identifying as women of color working in offices of academic testing. Faced with systemic oppression due to race and gender, women of color have opted in to a profession that is viewed by some as a threat and barrier to the…

Establishing a cut score is a crucial aspect of the test development process since the selected cut score has the potential to impact students' performance outcomes and shape instructional strategies within the classroom. Therefore, it is vital for those involved in test development to set a cut score that is both fair and justifiable. This cut…

The completion rates were compared for long-form questions where a large blank answer space is provided and for long-form questions where the answer space has bullet-points prompts corresponding to the parts of the question. It was found that students were more likely to complete a question when bullet points were provided in the answer space.…

The field of educational measurement has evolved considerably since the first doctoral programs were established. In response, programs have typically tacked on courses that address newly developed theories, methods, tools, and techniques. As our review of current programs evidences, this approach produces artificial distinctions among topics and…

This article explores what happens behind the closed doors and in the 'black box' of high-stakes educational testing. Our specific concern is licensure exams that are often gatekeepers into teacher education programs and the profession. Leveraging the spatial turn across critical social theory and other disciplines, we conceptualize the test space…

This three-paper dissertation explores item cluster-based assessments, first in general as it relates to modeling, and then, specific issues surrounding a particular item cluster-based assessment designed. There should be a reasonable analogy between the structure of a psychometric model and the cognitive theory that the assessment is based upon.…

In 2018, 26 states administered a college admissions test to all public school juniors. Nearly half of those states proposed to use those scores as their academic achievement indicators for federal accountability under the Every Student Succeeds Act (ESSA); many others are planning to use those scores for other accountability purposes.…

There has long been a concern about the lack of representation of ethnic minorities in the field of educational measurement. As previous research has shown that graduate programs primarily rely on their websites for recruiting efforts, the objective of this study was to conduct a content analysis of all U.S. educational measurement program…

This study aims to identify to what degree undergraduate students are able to manage the exam process to be successful in exams. The study group of the research, which utilizes the survey model, consists of 350 students in total, 185 female and 165 male, attending 4 different teaching programs in Faculty of Education, Gazi University. "The…

Given worldwide prevalence of low-stakes testing for monitoring educational quality and students' progress through school (e.g., Trends in International Mathematics and Science Study, Program for International Student Assessment), interpretability of resulting test scores is of global concern. The nonconsequential nature of low-stakes tests…

Multilevel models (MLMs) are flexible in that they can be employed to obtain item and person parameters, test for differential item functioning (DIF) and capture both local item and person dependence. Papers on the MLM analysis of item response data have focused mostly on theoretical issues where applications have been add-ons to simulation…

This paper addresses the way in which students' cognitive creativity and the construction of meaning could be fostered by means of assessment in a Problem-based learning programme. We propose that a dual assessment structure within such a programme through examinations and coursework assignments could ensure the acquisition of a foundational…

Professional standards for educational testing recommend that both the overall standard error of measurement and the conditional standard error of measurement (CSEM) be computed on the score scale used to report scores to examinees. Several methods have been developed to compute scale score CSEMs. This paper compares three methods, based on…

In the 2014-15 school year, 47 states are administering high school assessments to gauge students' mastery of college and career readiness standards in English language arts (ELA) and math. These new assessments represent a departure from prior high school exams that measured acquisition of high school (or lower) content but provided no actionable…