In the coming years, public programs will capture even more and richer data than they do now, including data from web-based tools used by participants in employment services, from tablet-based educational curricula, and from electronic health records for Medicaid beneficiaries. Program evaluators seeking to take full advantage of these data…

To date, evaluation research and policy analysis have focused mainly on average program impacts and paid little systematic attention to their variation. Recently, the growing number of multi-site randomized trials that are being planned and conducted make it increasingly feasible to study "cross-site" variation in impacts. Important…

For RCTs of education interventions, it is often of interest to estimate associations between student and mediating teacher practice outcomes, to examine the extent to which the study's conceptual model is supported by the data, and to identify specific mediators that are most associated with student learning. This article develops statistical…

The Even Start Family Literacy Program was established in 1989 to help break the cycle of poverty and illiteracy for low-income families, by improving the literacy skills of parents and their young children. Even Start projects offer family literacy services, defined as four integrated instructional components: (1) Childhood Education (ECE); (2)…

Central Massachusetts Library Administration Simulation Project (CLASP) was a research project funded under Title II-B to develop and test a simulation model that would enable public library personnel to learn and practice skills of negotiation, decision making, budgeting, and program planning. A simulation model was developed and tested in a…

The influence of three types of evaluation information was studied in simulated decision-making situations within a community mental health center setting. Administrators reviewed decision problems and were then presented political, cost/benefit, and statistical information one at a time. After each presentation, subjects rated the importance they…

The accuracy with which regression models estimate treatment effects is dependent upon a number of conditions. The stability of the regression line (a function of sample size and correlation between pretest and posttest) is said to be the most important of these conditions. The utility of regression models is proportional to the size of the…

This project, located in a large metropolitan school district, concerns the operation and evaluation of three Mathematics Demonstration Centers. In the first phase, directions are given about the necessary information to be gathered by the evaluating organization, (e.g. the school district administrative organization, size of school district,…

This paper reported on investigation in which a simulation, experimental class of student learning was compared with a control class where the simulation is not used. (Editor/RK)

A Monte Carlo study compared performance of linear and logistic mixed-model analyses of simulated community trials having specific event rates, intraclass correlations, and degrees of freedom. Results indicate that in studies with adequate denominator degrees of freedom, the researcher may use either method of analysis, with certain cautions. (SLD)

Focus: HOPE provides valuable, practical occupational training in machinist or information technology (IT) occupations to young people who face barriers to the development of viable careers through postsecondary education and training because of low-income, basic skills deficiencies, incarceration, or parenting responsibilities. This report…

In a simulated adversary-advocacy evaluation of a computer-assisted school guidance program, the evaluation audience's reaction to different forms of data, the order of argument presentations, and the rated attitude of the evaluator are shown to influence audience agreement with evaluation recommendations. (CM)

The results of a follow-up evaluation of a decision support system installed 5 years ago at Guilford College are reported. Changes in the system, resulting procedures, and the organization are described. (Author/MLW)

In simulated decision-making situations in a community mental health center, three types of information were studied and rated: political; cost-benefit, and statistical. Only cost-benefit information was rated as significantly influencing administrators' decisions. (MH)

The School of Education of Syracuse University implemented EXPER SIM, a computer simulation program, in a graduate program in instructional technology. During a one-semester course each student planned a program of research, developed a proposal for at least one experimental study, collected simulated data using EXPER SIM, analyzed and interpreted…