Decision consistency (DC) is the reliability of a classification decision based on a test score. In professional credentialing, the decision is often a high-stakes pass/fail decision. The current methods for estimating DC are computationally complex. The purpose of this research is to provide a computationally and conceptually simple method for…

Classification accuracy is a key characteristic of screening tools. A goal in classification accuracy is to correctly identify issues that result in a later problem and situations in which the scores identify issues that do not result in a later problem.

Criticisms about psychometric paradigms currently used in healthcare professions education include claims of reductionism, objectification, and poor compliance with assumptions. Nevertheless, perhaps the most crucial criticism comes from learners' difficulty in interpreting and making meaningful use of summative scores and the potentially…

At the end of every school year, particularly as students move on to middle or high school, educators throughout the nation face the same question: To reclassify or not to reclassify English Language Learners (ELLs)? The reclassification decision is tricky because it sometimes feels as if there is an inevitable tradeoff between specialized…

Randomized controlled trials are not always feasible in educational research, so researchers must use alternative methods to study treatment effects. Propensity score matching is one such method for observational studies that has shown considerable growth in popularity since it was first introduced in the early 1980s. This paper outlines the…

Subscore reporting under item response theory models has always been a challenge partly because the test length of each subdomain is limited for precisely locating individuals on multiple continua. Diagnostic classification models (DCMs), providing a pass/fail decision and associated probability of pass on each subdomain, are promising…

This document contains the technical appendices for the report "Targeted K-12 Funding and Student Outcomes: Evaluating the Local Control Funding Formula." Appendices include: (1) Data Sources and Sample Construction; (2) Estimating Effects on Student Outcomes; (3) Estimating Targeting Using School Site Spending Data; and (4) Supplemental…

This study used latent class analysis with data from the 2002/03 Head Start Impact Study to determine whether early childhood classrooms can be sorted into classroom quality groups based on their scores on multiple measures of quality, how many classroom quality groups could be identified, and what percentages of classrooms fall within each…

In this article, we propose the concept of "Autonomic Cycle Of Learning Analysis Tasks" (ACOLAT), which defines a set of tasks of learning analysis, whose objective is to improve the learning process. The data analysis has become a fundamental area for the knowledge discovery from data extracted from different sources. In the autonomic…

Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This paper introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…

Test scores are commonly reported in a small number of ordered categories. Examples of such reporting include state accountability testing, Advanced Placement tests, and English proficiency tests. This article introduces and evaluates methods for estimating achievement gaps on a familiar standard-deviation-unit metric using data from these ordered…

ACT reporting categories and ACT Readiness Ranges are new features added to the ACT score reports starting in fall 2016. For each reporting category, the number correct score, the maximum points possible, the percent correct, and the ACT Readiness Range, along with an indicator of whether the reporting category score falls within the Readiness…

This Data Point uses data from the 2012 administration of the Program for International Student Assessment (PISA) financial literacy assessment. PISA is an international assessment that measures 15-year-old students' reading, mathematics, and science literacy and, in 2012, general problem solving and financial literacy. PISA is coordinated by the…

Rhode Island's School Accountability system is in a period of transition to the Every Student Succeeds Act (ESSA). The accountability data released October 2017 is based on the 2016-17 administration of the PARCC assessment. Results from the Multi-State Alternate Assessment in ELA/literacy and mathematics are also included. The results of this…

Immigrant youth who are designated as English language learners in American schools--whom we refer to as "emergent bilinguals"--are increasingly framed by numerical calculations. Utilizing the notion of assemblage from actor-network theory (ANT), we trace how emergent bilinguals are discursively constructed by officials, administrators,…