Many teacher education researchers have expressed concerns with the lack of rigorous impact evaluations of teacher preparation practices. I summarize these various concerns as they relate to issues of internal validity, external validity, and measurement. I then assess the prevalence of these issues by reviewing 166 impact evaluations of teacher…

This brief is part of a series that explores key implementation considerations. It focuses on the importance of identifying, operationalizing, and implementing the "core components" of evidence-based and evidence-informed interventions that likely are critical to producing positive outcomes. The brief offers a definition of "core components",…

As evidence-based reform becomes increasingly important in educational policy, it is becoming essential to understand how research design might contribute to reported effect sizes in experiments evaluating educational programs. The purpose of this study was to examine how methodological features such as types of publication, sample sizes, and…

"Evaluation Theory, Models, and Applications" is designed for evaluators and students who need to develop a commanding knowledge of the evaluation field: its history, theory and standards, models and approaches, procedures, and inclusion of personnel as well as program evaluation. This important book shows how to choose from a growing…

The purpose of this Guide is to advise researchers, policymakers, and others on when it is possible to conduct a high-quality randomized controlled trial in education at reduced cost. Well-designed randomized controlled trials are recognized as the gold standard for evaluating the effectiveness of an intervention (i.e., program or practice) in…

The naturalistic research perspective assumes that reality is multiplistic, phenomenological, and context-dependent. This perspective legitimizes the subjective insights of the investigator by acknowledging the interdependence of facts and values as well as of the investigator and the object of investigation. Although discrepancies between…

Based on an independent analysis of the data used to evaluate the Developmental Economic Education Program, questions are raised about the methodology and conclusions reached by Walstad and Soper in an article published in the Winter 1982 issue of the Journal. The original study is also defended in two replies. (Author/RM)

Improvement in the research climate in children's librarianship is needed. There must be a determined demand for research, financial and job support for researchers, improvement in the research techniques for studying children, and implementation of actual research projects. Particular concerns include research on reading, school/public library…

Discusses a technique for estimating sample size that does not require an a priori definition of desired precision. Presents five modifications that make the method easier to use and reduce the probability of estimating a larger sample size than necessary. The technique can guide the design of environmental sampling programs. (Contains 31…

Lakatos's methodology of scientific research programs is summarized and discussed for Piagetian schools and alternative conceptions movement. Commonalities/differences between these two rival programs are presented along with fundamental assumptions, auxiliary hypotheses, and research policy. Suggests that research findings should not be merely…

Future research in Follow Through should be eclectic and comprehensive. In particular, the setting for Strand Two of the National Institute of Education's (NIE) research program for Follow Through should provide opportunities for sponsors of innovations to implement programs targeted at many outcomes. There should be a commitment to measuring…

This is a checklist of key items to get right when conducting a randomized controlled trial to evaluate an educational program or practice ("intervention"). It is intended as a practical resource for researchers and sponsors of research, describing items that are often critical to the success of a randomized controlled trial. A significant…

A repeated measures design was used to assess the effects of a methadone maintenance program in several California locations. Subjects were 720 Chicano and Anglo men and women participating in rehabilitation programs for heroin addicts. The subjects were interviewed between 1978-1981, and the average follow-up time after initial treatment was 4-6…

This paper reports the process by which Anne Arundel County Public Schools evaluated its mathematics program. The steps are outlined by which the evaluation was initiated, designed, implemented, and reported. The procedures developed to address and implement the evaluation findings and recommendations are described. The evaluation was intitiated…

This report for researchers in rural sociology develops a conceptual and analytic framework for evaluating policies or programs through interrelated models. Three models--structural analysis, control programming, and simulation--allow researchers to assess policy/program impact, determine why expected impacts did or did not occur, and modify…