Most existing solutions to the current replication crisis in science address only the factors stemming from specific poor research practices. We introduce a novel mechanism that leverages the experts' predictive abilities to analyze the root causes of replication failures. It is backed by the principle that the most accurate predictor is the most…

While score comparability across test forms typically relies on common (or randomly equivalent) examinees or items, innovations in item formats, test delivery, and efforts to extend the range of score interpretation may require a special data collection before examinees or items can be used in this way--or may be incompatible with common examinee…

The Data Quality Campaign (DQC) has been reviewing state report cards for the past seven years. They continue to examine the landscape of state report cards because they believe states must increase transparency and build trust by sharing information. But after many years, it was time to look at state report cards with fresh eyes. In addition to…

The EdSurvey package helps users download, explore variables in, extract data from, and run analyses on large-scale assessment data. The analysis functions in EdSurvey account for the use of plausible values for test scores, survey sampling weights, and their associated variance estimator. We describe the capabilities of the package in the context…

Beginning with the 2020/21 school year, the Massachusetts Department of Elementary and Secondary Education (DESE) began an ongoing effort to collect and analyze literacy screening assessment data from schools and districts participating in certain state grants to inform improvement efforts. Grantee schools and districts that provide literacy…

This research report provides a description of the processes of evaluating the "deployability" of automated scoring (AS) systems from the perspective of large-scale educational assessments in operational settings. It discusses a comprehensive psychometric evaluation that entails analyses that take into consideration the specific purpose…

State policymakers are confronting well-documented intersecting crises -- medical, economic, and racial -- with especially dire implications for educational equity. State education leaders face a moral urgency to both understand and respond to the challenges students are experiencing and to do so in ways that address burgeoning equity gaps.…

Connecticut experienced two major changes in testing policy for children with disabilities that played a major role in conclusions about educational progress in the state. First, the No Child Left Behind Act (NCLB) of 2001 required that all students with disabilities participate in grade-level, standardized tests. This movement of students…

This report describes the adult student's experience with prior learning assessment (PLA) using student record data from 72 degree-granting postsecondary institutions in the United States, primarily focusing on the data from 69 of those institutions based on the more detailed data provided by those institutions to the study. Researchers from the…

This report describes the adult student's experience with prior learning assessment (PLA) using student record data from 72 degree-granting postsecondary institutions in the United States, primarily focusing on the data from 69 of those institutions based on the more detailed data provided by those institutions to the study. Researchers from the…

Rural districts have long faced challenges in closing achievement gaps between subgroups of students. This brief report describes key decision points and considerations for decision-makers interested in identifying rural districts that have closed academic achievement gaps. Examining practices in these districts may suggest activities associated…

When it comes to measuring the quality of a school, policy leaders tend to embrace standardized tests as the go-to indicator, whereas parents and community members tend to rely on reputation, word-of-mouth, and what they perceive with their own eyes. The authors suggest a better approach: a new framework that looks at three categories of inputs…

This article describes three types of data that can impact how instructional coaches face the challenges in measuring the impact of their work with teachers on student learning. Descriptions of the three types of data--"shifts in teacher reflective tendencies," "the use of student performance as an indicator of success," and…

This event focused on the What Works Clearinghouse practice guide, "Using Student Achievement Data to Support Instructional Decision Making" (ED506645). During the event, the presenter, Sharnell Jackson, led school data teams in activities involving analysis of their own student data. This Q&A addressed the questions participants had…

Dashboard systems are increasingly popular as assessment and performance management tools in higher education. This chapter examines the use of dashboards in student affairs, including examples of key indicators and considerations for developing and implementing these tools. The chapter begins with an overview of the origins of dashboards, from…