The study describes an evaluation of a 48-week physical activity and nutritional education programme for overweight/obese school-age children using quantitative and qualitative methods. The majority of participants were obese or severely obese when enrolled, and while some improvements in body mass index, self-esteem and engagement in a range of…

In 2002, voters in Florida approved a constitutional amendment limiting class sizes in public schools to 18 students in the elementary grades, 22 students in middle grades, and 25 in high school grades. Analyzing statewide achievement data for school districts from 2004-2006 and for schools in 2007, this study purports to find that "mandated…

The gold standard in making causal inference on program effects is a randomized trial. Most randomization designs in education randomize classrooms or schools rather than individual students. Such "clustered randomization" designs have one principal drawback: They tend to have limited statistical power or precision. This study aims to…

This article shows how microcomputer software can help in overcoming key methological problems in program/policy evaluation by: (1) paired comparisons; (2) sensitivity analysis to deal with missing information; (3) allocation percentages to deal with multiple alternatives; (4) sub-optimizing to deal with conflicting constraints; and (5) decision…

A new report published by the Manhattan Institute for Education Policy, "The Effect of Special Education Vouchers on Public School Achievement: Evidence from Florida's McKay Scholarship Program," attempts to examine the complex issue of how competition introduced through school vouchers affects student outcomes in public schools. The…

Program impact methodology--usually referred to as evaluation research--is described as it is developing in the United States. Several problems face the field of evaluation research. First, those issues grouped as "meta-scientific" include: (1) the distinction between qualitative and quantitative studies; (2) the separation of implementation and…

The study under review is the second-year evaluation report of the Milwaukee Parental Choice Program (MPCP), a publicly funded voucher program that allows low-income students in Milwaukee to attend secular and religious private schools in that city. Its primary finding is that there were no overall statistically significant differences in…

Methods of using simplified time series analysis (STSA) in evaluating clinical programs are discussed. STSA assists in addressing problems of attrition/augmentation of subjects in programs with changing populations. Combining individually calculated "C" statistics in a simple aggregate analysis of restraint usage by nursing home staff…

A Friedman Foundation report attempts to find empirical support for the contention that competition from private schools, through voucher programs, improves the effectiveness of public schools. In the first year of Ohio's new EdChoice voucher program, the report claims to have found substantial academic gains at public schools exposed to the…

Discusses the following aspects of educational evaluation: (1) structural changes; (2) conceptual changes; (3) mixed methods and unraveling consensus; (4) utilization of findings; (5) the role of values; and (6) the role of politics. Discusses how evaluation moved from monolithic to pluralistic, reflecting the change from consensus to pluralism in…

Maintains that a professionally conducted assessment, both quantitative and qualitative, is the beginning of successful strategic planning. Discusses assessment standards and identifies future assessment models for music education. Considers the use of quantitative and qualitative assessments and addresses what should occur during a three-year…

In 1990, Milwaukee (Wisconsin) became the site of the first publicly funded school-choice program providing low-income parents with vouchers that could be used to send their children to secular, private schools. An evaluation of Milwaukee's school-choice experiment was conducted by a team of researchers, headed by John Witte at the University of…

Discusses the evaluation of second and foreign language programs, focusing on whether such evaluations should be summative or formative; use outside experts or program staff; emphasize qualitative or quantitative data; and concentrate on the process or the product. An annotated bibliography discusses six important works in the field. (78…

The future of program evaluation is bright if evaluators do not ignore their roots in quantitative research. The current interest in qualitative approaches and the call for a "fourth generation" in evaluation should not override training in quantitative research. Qualitative research should complement, rather than replace, traditional…

Although methodological integrity is not the sole determinant of the value of a program evaluation, decision-makers do have a right, at a minimum, to be able to expect competent work from evaluators. This paper explores five areas where evaluators might improve methodological practices. First, evaluation reports should reflect the limited…