Recent years have produced a surge in interest in improving state assessment programs. Many states are designing new assessments. Much of this innovation is aimed at addressing longstanding areas of unhappiness with typical domain-sampled, end-of-year state assessments: States want to streamline assessment activities, enhance the instructional…

Educational testing has been criticized for its disconnect from modern cognitive science and its limited role in improving instruction and student learning. Reform efforts emphasize the need for testing to provide specific diagnostic insights into students' skills and knowledge. Cognitive diagnosis (CD), an emerging paradigm in educational…

Aberrant behavior refers to any type of unusual behavior that would not be expected under normal circumstances. In educational and psychological testing, such behaviors have the potential to severely bias the aberrant examinee's test score while also jeopardizing the test scores of countless others. It is therefore crucial that aberrant examinees…

Technical difficulties occasionally lead to missing item scores and hence to incomplete data on computerized tests. It is not straightforward to report scores to the examinees whose data are incomplete due to technical difficulties. Such reporting essentially involves imputation of missing scores. In this paper, a simulation study based on data…

We explored three approaches to resolving or re-scoring constructed-response items in mixed-format assessments: rater agreement, person fit, and targeted double scoring (TDS). We used a simulation study to consider how the three approaches impact the psychometric properties of student achievement estimates, with an emphasis on person fit. We found…

In educational tests, a group of questions related to a shared stimulus is called a testlet (e.g., a reading passage with multiple related questions). Use of testlets is very common in educational tests. Additionally, computerized adaptive testing (CAT) is a mode of testing where the test forms are created in real time tailoring to the test…

This dissertation was designed to provide current information on the job satisfaction and organizational commitment of those identifying as women of color working in offices of academic testing. Faced with systemic oppression due to race and gender, women of color have opted in to a profession that is viewed by some as a threat and barrier to the…

The problem of this research is how to use assessment for school learning and what are students' creative thinking skills? Research objectives: First, to uncover, analyze, identify, describe the learning assessment used by teachers and students of Nusantara Indah Sintang Senior High School. Second, to express, analyze and describe students'…

We draw upon Appadurai's 'scapes' and Latour's Actor Network Theory (ANT) to interrogate historical and spatial flows in relation to specific testing technologies. We reveal how testing systems, conceptualised as actor-networks, rearticulate colonial legacies of inequality which are intensified by new and emerging technologies. ANT helps trace…

This dissertation aims to bridge the gap between validity theory and the practice of validation. The dissertation employs a three-article approach. Following the introduction in Chapter I, three independent manuscripts representing three empirical studies are presented (i.e., Chapters II - IV). Each chapter is a stand-alone publishable manuscript,…

Assessment is one of the five functions of the educational psychologist's (EP's) role, yet there is a dearth of research exploring its distinctive contribution to school-based practice, and a lack of definition about what it is. In this study, the assessment practices of EPs were compared with those of other educational professionals who had…

Using the method of narrative review, this paper considers the impact of structural inequity in US society and its implications for educational assessment. Focusing on African Americans, some of the many past and present examples of structural inequity and their effects are delineated. Described next are how these effects can be connected to…

The Indiana Department of Education's (IDOE's) Accessibility and Accommodations Information for Statewide Assessments is intended for school-level personnel and decision-making teams as they prepare for and implement Indiana statewide assessments. Information is provided for school personnel as a reference to inform guidance on accessibility…

This paper analyzes the nature and perceived effects of mid-stakes testing (known as the EQAO) in Ontario, Canada. Ontario's mid-stakes tests were meant to ensure accountability and transparency, and assure system-wide improvement, while avoiding the negative effects and perverse incentives of their high-stakes counterparts. The paper provides new…

Errors in examination papers and other assessment instruments can compromise fairness. For example, a history question containing an incorrect historical date could be impossible for students to answer. Incorrect instructions at the start of an examination could lead students to answer the wrong number of questions. As there is little research on…