The synthetic control method (SCM) is a popular approach for estimating the impact of a treatment on a single unit with panel data. Two challenges arise with higher frequency data (e.g., monthly versus yearly): (1) achieving excellent pre-treatment fit is typically more challenging; and (2) overfitting to noise is more likely. Aggregating data…

The evidence-based decision-making movement often assumes that once evidence is available (e.g., via the What Works Clearinghouse), decision-makers will integrate it into their practice. Research-practice partnership studies have shown this is not always true. In this paper, we argue that instead of assuming research will be useful and used, we…

Academics are not immune to the biases contributing to persistent inequalities in society. We face an urgent need to overhaul and dismantle current evaluation practices that uphold inequities at multiple points along the academic pipeline. Graduate admissions and faculty advancement are two arenas of gatekeeping in which a reimagining and…

Several programs of research have sought to assess the replicability of scientific findings in different fields, including economics and psychology. These programs attempt to replicate several findings and use the results to say something about large-scale patterns of replicability in a field. However, little work has been done to understand the…

Interest in school-based strategies to support student social and emotional learning (SEL) is strong. Although SEL policies and programs designed to support the development of student competencies have advanced significantly, less work has been done to develop methods of assessing student social and emotional competence. This article briefly…

The goal in personalized assessment is to best fit the needs of each individual test taker, given the assessment purposes. Design-In-Real-Time (DIRTy) assessment reflects the progressive evolution in testing from a single test, to an adaptive test, to an adaptive assessment "system." In this paper, we lay the foundation for DIRTy…

Given the widespread use of non-experimental (NE) methods for assessing program impacts, there is a strong need to know whether NE approaches yield causally valid results in field settings. In within-study comparison (WSC) designs, the researcher compares treatment effects from an NE with those obtained from a randomized experiment that shares the…

In the United States, educational thought leaders have called for higher expectations (Gordon Commission, 2010), more rigorous college and career readiness standards for K-12 education (National Governors Association Center for Best Practices & Council of Chief State School Officers, 2010), and new constructs such as 21st century skills…

The foster youth education program strives to increase graduation rates by improving academic performance and encouraging student retention through an innovative collaboration between tutors, social workers, and schools to provide individualized support. The pilot program was funded by U.S. Department of Education Innovation Funds, which evolving…

Biased sampling occurs frequently in economics, epidemiology, and medical studies either by design or due to data collecting mechanism. Failing to take into account the sampling bias usually leads to incorrect inference. We propose a unified estimation procedure and a computationally fast resampling method to make statistical inference for…

Recent advances in cognitive science and psychometrics have expanded the possibilities for the next generation of literacy assessment as an integrated domain (Bennett, 2011a; Deane, Sabatini, & O'Reilly, 2011; Leighton & Gierl, 2011; Sabatini, Albro, & O'Reilly, 2012). In this paper, we discuss four key areas supporting innovations in…

The comparison of the Russian and American experience regarding media violence, standards for rating Russian media programs, and a course of study on media violence for students will have a significant impact upon Russian society, will raise Russian societal and governmental attention to the infringement of the Rights of the Child on the Russian…