The proposed paper utilizes teacher and student data from the 2014 U.S. National Assessment for Education Progress 8th grade Civics test (NAEP-Civics8) to explore the relationship between teacher pedagogical practices and other factors (i.e., teacher credentials, teacher professional characteristics, individual traits, and teachers' education…

The National Assessment of Educational Progress (NAEP) has tested the civic, or citizenship knowledge of students across the nation at irregular intervals since its very inception. Despite advancements in reading and mathematics, evidenced by results from the National Assessment of Educational Progress (NAEP), civics proficiency has remained…

This paper aims to identify and compare key factors influencing US States' or an OECD country's decision to employ student test scores or test score value-added (VAM) in evaluating teacher effectiveness. Analysis using multiple linear probability model and logistic regression frameworks indicates that the use of VAM/student test scores was…

The National Assessment of Educational Progress (NAEP) results have long displayed student achievement in two ways: as points on a stable vertical scale that typically runs from 0 to 300 or 500 and as the percentages of test takers whose scores reach or surpass a trio of "achievement levels." These achievement levels--dubbed…

The EdSurvey package helps users download, explore variables in, extract data from, and run analyses on large-scale assessment data. The analysis functions in EdSurvey account for the use of plausible values for test scores, survey sampling weights, and their associated variance estimator. We describe the capabilities of the package in the context…

At the level of the 50 U.S. states, an interconnected nexus of well-being variables exists. These variables strongly correlate with estimates of state IQ in interesting ways. However, the state IQ estimates are now more than 16 years old, and the state well-being estimates are over 12 years old. Updated state IQ and well-being estimates are…

Virginia governor Glenn Youngkin and his administration want to raise the bar for students to pass the state's standardized tests "from the lowest in the nation to the highest in the nation" by next spring. His goal is to close the "honesty gap" between the 79 percent of Virginia students who pass the state's tests and the 39…

The current study expands on previous research on gender differences and similarities in science test scores. Using three different approaches -- differential item functioning, differential distractor functioning, and decision tree analysis -- we examine a high school science assessment administered to 3,849 10th-12th graders, of whom 2,021 are…

Regression discontinuity (RD) designs are commonly used for program evaluation with continuous treatment assignment variables. But in practice, treatment assignment is frequently based on ordinal variables. In this study, we propose an RD design with an ordinal running variable to assess the effects of extended time accommodations (ETA) for…

Background/Context: Regression discontinuity (RD) designs are used for policy and program evaluation where subjects' eligibility into a program or policy is determined by whether an assignment variable (i.e., running variable) exceeds a pre-defined cutoff. Under a standard RD design with a continuous assignment variable, the average treatment…

After 25 years with small to moderate gains in performance in mathematics, scores on the National Assessment of Educational Progress (NAEP) main assessment declined between 2013 and 2015 in Grades 4 and 8. Previous research has suggested the decline may be linked to the implementation of the "Common Core" state standards. In this…

Concerns about the negative effects of digitalization on students' reading comprehension, empirically backed by recent meta-analyses, question the efficacy of digital tools in the language arts classroom. By analyzing data from 4 and 8th grade US students from NAEP 2017, we aimed to test the generalization of the negative association between…

The present paper investigates and examines the conditional dependencies between cognitive responses (RA; Response Accuracy) and process data, in particular, response times (RT) in large-scale educational assessments. Using two prominent large-scale assessments, NAEP and PISA, we examined the RA-RT conditional dependencies within each item in the…

Given the importance of early literacy to long-term student success, by 2021, 41 states and the District of Columbia adopted early literacy policies to improve student literacy by the end of third grade. We use an event-study approach to examine the impact of these policies on high- and low-stakes test scores. Our results suggest that adopting an…

Using narrow test scores as the only means of accountability does not serve students, teachers, or schools. Jonathan E. Collins writes that policy makers and educators should consider accountability as an education system designed to be accountable to the best version of students. This means assessing outcomes that policy makers too easily…