Policymakers have grown increasingly interested in how experimental results may generalize to a larger population. However, recently developed propensity score-based methods are limited by small sample sizes, where the experimental study is generalized to a population that is at least 20 times larger. This is particularly problematic for methods…

We compared students' performance on a paper-based test (PBT) and three computer-based tests (CBTs). The three computer-based tests used different test navigation and answer selection features, allowing us to examine how these features affect student performance. The study sample consisted of 9,698 fourth through twelfth grade students from across…

The current simulation study examined the effects of Item Parameter Drift (IPD) occurring in a short scale on parameter estimates in multilevel models where scores from a scale were employed as a time-varying predictor to account for outcome scores. Five factors, including three decisions about IPD, were considered for simulation conditions. It…

We use data from a large-scale, school-level randomized experiment conducted in 2010-2011 in public schools in Indiana. Our sample includes more than 30,000 students in 70 schools. We examine the impact of two interim assessment programs (i.e., mCLASS in Grades K-2 and Acuity in Grades 3--8) on mathematics and reading achievement. Two-level models…

Background: School administrators and teachers face difficult decisions about how best to use school resources to meet academic achievement goals. Many are hesitant to adopt prevention curricula that are not focused directly on academic achievement. Yet, some have hypothesized that prevention curricula can remove barriers to learning and, thus,…

In a rigorous evaluation of ASSISTments as an online homework support conducted in the state of Maine, SRI International reported that "the intervention significantly increased student scores on an end-of-the-year standardized mathematics assessment as compared with a control group that continued with existing homework practices."…

This study used administrative data from Wisconsin Virtual School to identify patterns of student engagement in online courses (defined as the amount of time students were logged in to their course each week and how this varied over time). The study also examined whether the patterns were associated with course outcomes (defined as the percentage…

Student enrollment in online courses has increased in the past 15 years and continues to grow. However, little is known about students' education experiences or online course outcomes. These are areas of particular interest to the Midwest Virtual Education Research Alliance, whose goal is to understand how to support student success in online…

Purpose: There is a tendency to assess educational systems in terms of their efficiency in gaining high scores on cognitive skills. Schools perform, however, also a socializing function. The whole policy debate tends to ignore the impact of educational systems on attitudes or democratic values. This contribution focuses on the impact of the…

To identify ways that national culture, school characteristics, and individual attributes impact the victimization of students in Grade 8, data from the United States and three East Asian countries (i.e., Japan, S. Korea, and Taiwan) were compared using the 2011 Trends in International Mathematics and Science Study (TIMSS) and Hierarchical Liner…

What is "teaching to the test," and can one detect evidence of this practice in state test scores? This paper unpacks this concept and empirically investigates one variant of it by analyzing test item--level data from three states' mathematics and reading tests. We show that NCLB-era state tests predictably emphasized some state…

It is a common knowledge that student achievement is a product of multiple individual and environmental factors. The literature developed various models to organize and explain the relationship between some of these variables and student learning which translates into student achievement. Yet, no comprehensive model is able to capture all possible…

Magnet schools are one of the largest sectors of choice schools in the United States. In this study, we explored whether there is heterogeneity in magnet school effects on student achievement by examining the effectiveness of 24 recently funded magnet schools in 5 school districts across 4 states. We used a two-step analysis: First, separate…

This article examines the relationship between after-school program quality, program attendance, and academic outcomes for a sample of low-income after-school program participants. Regression and hierarchical linear modeling analyses use a unique longitudinal data set including 29 after-school programs that served 5,108 students in Grades 4 to 8…

Background/Context: The fulfillment of academic potential is an underdeveloped area of inquiry as it relates to explaining racial differences in academic outcomes. Examining this issue is important for addressing not only differences in the typical outcomes for African American and White students but also the severe underrepresentation of African…