The regression discontinuity design (RDD) has the potential to yield findings with causal validity approaching that of the randomized controlled trial (RCT). However, Schochet (2008a) estimated that, on average, an RDD study of an education intervention would need to include three to four times as many schools or students as an RCT to produce…

This handbook is intended to help educational evaluators use still photography in designing, conducting, and reporting evaluations of educational programs. It describes techniques for using a visual documentary approach to program evaluation that features data collected with a camera. The emphasis is on the aspects of educational evaluation…

Limiting data collection to a sample group is one way to increase effectiveness in dealing with data. The paper describes how to draw a sample group (random sampling, stratified random sampling, purposeful sampling, and convenient or opportunity sampling) and discusses how to determine the size of the sample group. (SM)

Describes two types of criterion-referenced testing that districts can use to measure achievement outcomes of their instructional programs: a random sampling assessment plan and an item-response theory assessment plan. (Author/JM)

The first phase of a monitoring project to evaluate the implementation of the Chicago Reform Act, with a focus on the process of securing school participation in the study, is described in this report. Twelve schools out of a random stratified sample of 16 schools agreed to participate in the study, which was to consist of interviews and classroom…

Details the procedures followed in obtaining a frequency-of-use list of the most-to-least-used instructional materials in mathematics (K-12), reading (K-6), and science and social studies (each 7-12). (Author/MLF)

The use of outcome assessment in special education is reviewed. Outcome assessments differ widely in design, measures, and data collection, but they share a common focus on outcomes as individual achievements, statuses, or behaviors. Assessments of special education outcomes often have an evaluative purpose in reflecting how well the special…

This article presents a discussion of field utilization of staff development activities in the context of three separate training programs. Specifically, classroom implementation of knowledge and skills gained by participants in their training sessions was assessed via the Levels of Use (LoU) interview system. (Author/LMO)

In 1988, whether the National Assessment of Educational Progress (NAEP)--the "Nation's Report Card"--could become a report card for the states was studied. A trial assessment program was authorized to determine whether state assessments following the NAEP format could produce reliable and useful estimates of educational progress. This…

This paper discusses a number of interventions that are aimed at increasing educational opportunities of homeless students in the United States. Only a few of these programs have been locally evaluated, and the evaluation process is particularly challenging for local evaluators to undertake. At a state and national level, commitment to evaluation…

The dominant issues in considering the use of tests developed outside the classroom to measure the impact of curriculum reform on higher order thinking are reviewed by a panel interviewed for this discussion. Panel members are: (1) Stuart Kahl, (2) Robert Linn, (3) Senta A. Raizen, (4) Lauren Resnick, and (5) Thomas A. Romberg. It is conceded…

A profile of state-wide educational assessment programs is constructed, and the means by which such programs have changed over time and may change in the future are discussed. Data for the study were taken from biennial surveys by the Association of State Assessment Programs, first conducted in 1977. This study covers data on time of survey…

A review of the National Assessment of Educational Progress (NAEP), which originated 20 years ago, is presented; and the original political, ideological and social science assumptions for the design of NAEP are examined. The report criticizes the founding principle as hampering NAEP's maximum utility and exploratory power. In examining the form of…

This evaluation handbook was written for school district personnel who may be either novices or experts in the use of educational research techniques. Tailored to categorically aided projects, the handbook describes techniques that will isolate specific activity effects as reflected by pupil achievement. Chapters are devoted to the construction of…

The implementation of research design in studies on substance abuse education is discussed in this meta-analysis. Findings indicate that the quality of research design is constrained by negative feedback from evaluation stakeholders. This finding is applied to an evaluation of the Here's Looking at You, 2000 drug education program currently…