We explore the conditions under which short, comparative interrupted time-series (CITS) designs represent valid alternatives to randomized experiments in educational evaluations. To do so, we conduct three within-study comparisons, each of which uses a unique data set to test the validity of the CITS design by comparing its causal estimates to…

The present article considers a fundamental question in evaluation research: "By how much do program effects vary across sites?" The article first presents a theoretical model of cross-site impact variation and a related estimation model with a random treatment coefficient and fixed site-specific intercepts. This approach eliminates…

Policymakers are revolutionizing teacher evaluation by attaching greater stakes to student test scores and observation-based teacher effectiveness measures, but relatively little is known about why they often differ so much. Quantitative analysis of thirty schools suggests that teacher value-added measures and informal principal evaluations are…

In accordance with the federal No Child Left Behind (NCLB) law of 2001, 100% of students were expected to become proficient on state assessments of reading and mathematics by the end of 2013-2014 academic year. Schools that consistently failed to meet the NCLB's Adequate Yearly Progress requirements were subject to penalties. In 2011, the U.S.…

When lotteries are infeasible, researchers must rely on observational methods to estimate charter effectiveness at raising student test scores. Considerable attention has been paid to observational studies by the Stanford Center for Research on Education Outcomes (CREDO), which have analyzed charter performance in 27 states. However, the…

School impact media studies indicate that a well-staffed and funded school library media program with a certified school library media specialist (SLMS) positively correlates with increased student achievement. SLMS must have a shared understanding of their roles and responsibilities to positively impact student success. In an effort to determine…

As schools implement response to intervention to identify and serve students with learning difficulties, it is critical for educators to know how to evaluate screening measures. In the present study, "Dynamic Indicators of Basic Early Literacy Skills" Oral Reading Fluency was used to compare the differential decisions that might occur in…

"If someone were traveling to our area for the first time during this time of year, what would you tell them to bring to wear? Why?" This question was used to engage students in a guided-inquiry unit about how climate differs from weather. In this lesson, students explored local and national data sets to give "travelers" advice…

Many Medicaid programs have either fully or partially carved out mental health services. The evaluation of carve-out plans requires a case-mix model that accounts for differing health status across Medicaid managed care plans. This article develops a diagnosis-based case-mix adjustment system specific to Medicaid behavioral health care. Several…

Background: Research indicates expert and novice teachers communicate differently during instruction. However, these differences have yet to be investigated in relation to student learning. Receiver selectivity theory offers an interpretive framework for understanding how expert-novice communication differences might function to discriminate…

Performance assessment is an integral part of young musicians' development. Students enrolled in music programs frequently participate in adjudication festivals and many audition for select ensembles. Outcomes of such events are deemed consequential among all concerned: students, parents, teachers, and administrators. Furthermore, the number of…

In 2002, voters in Florida approved a constitutional amendment limiting class sizes in public schools to 18 students in the elementary grades, 22 students in middle grades, and 25 in high school grades. Analyzing statewide achievement data for school districts from 2004-2006 and for schools in 2007, this study purports to find that "mandated…

The current study will examine possible contextual effects relative to differences in reading comprehension performance in the state of Florida. While the Reading First (RF) Impact study examined such difference using a regression discontinuity design, the authors are primarily interested in other analytic methods that might answer different…

Research in the field of attribution theory and academic achievement suggests a relationship between a student's attributional style and achievement. Theorists and researchers contend that attributions influence individual reactions to success and failure. They also report that individuals use attributions to explain and justify their performance.…

In 2004 Embry-Riddle Aeronautical University transitioned from proctored examinations for distance learning courses to online examinations that are not proctored. The purpose of this study was to determine if there is a significant difference in the midterm and final examination grades between proctored and non-proctored online examinations. Three…