Short comparative interrupted times series (CITS) designs are increasingly being used in education research to assess the effectiveness of school-level interventions. These designs can be implemented relatively inexpensively, often drawing on publicly available data on aggregate school performance. However, the validity of this approach hinges on…

The "Integrated Approaches to Supporting Child Development and Improving Family Economic Security" project was conducted by Mathematica Policy Research and Northwestern University for the Office of Planning, Research and Evaluation (OPRE), in the Administration for Children and Families (ACF) at the U.S. Department of Health and Human…

This brief is part of a series that explores key implementation considerations. It focuses on the importance of identifying, operationalizing, and implementing the "core components" of evidence-based and evidence-informed interventions that likely are critical to producing positive outcomes. The brief offers a definition of "core components",…

The naturalistic research perspective assumes that reality is multiplistic, phenomenological, and context-dependent. This perspective legitimizes the subjective insights of the investigator by acknowledging the interdependence of facts and values as well as of the investigator and the object of investigation. Although discrepancies between…

Content analysis of critical events methodology is demonstrated in an evaluation of the Educational Telecommunications for Alaska (ETA) Project. This methodology was used to collect and interpret the data derived from the ETA staff personnel representing five components of the project. The data were analyzed using content analysis procedures. The…

The Project on Secondary Analysis directed its attention to methodology and policy issues, focusing on reanalysis of existing data (1979-82)--surveys, program evaluations, etc.--as a vehicle for learning how to improve methods of obtaining and analyzing data, designing program evaluations, and constructing policy to enhance the quality and utility…

The focus of this study was on the visual analysis of time series data for evaluating educational programs. Two characteristics of the data--changes in slope and variability--and two characteristics of evaluation--training in data utilization and the use of aimlines/decision rules--were manipulated. A total of 51 students and/or teachers in…

The REDSIL model for ongoing evaluation of gifted education programs involves interviewing stakeholders, isolating and categorizing critical study issues, designing a data collection plan that uses several forms of qualitative methods, implementing the plan, analyzing data, searching literature relative to each issue, analyzing data again, and…

This article examines the relationship between an adolescent with behavior disorders, his family, and the system of care, through a single case analysis. The methodology used to collect the case record and interview data and to analyze and graphically illustrate the data are presented to demonstrate use of qualitative data in program evaluation.…

Data on the intrinsic characteristics of an educational program are essential in pilot testing new programs in order to determine how successfully design components have achieved their intended purpose. At the outset of an evaluation of such data, it is necessary to define the evaluator's role and determine what intrinsic information will be…

This is a checklist of key items to get right when conducting a randomized controlled trial to evaluate an educational program or practice ("intervention"). It is intended as a practical resource for researchers and sponsors of research, describing items that are often critical to the success of a randomized controlled trial. A significant…

This paper reviews analytic methods for estimating growth curves or developmental trajectories from longitudinal data. Traditional models for studying change are contrasted with a relatively new method, hierarchical linear models. Evidence is presented indicating that hierarchical linear models can overcome some of the methodological limitations…

Guidelines for conducting departmental reviews are presented to help review panels, departments being reviewed, and administrators. In planning a review, the following considerations are important: the purpose of the review and the terms of reference, the organization of the review and who will conduct it, and the information that will be…

This report examines whether a high school curriculum organized around the five "new basics" suggested by the National Commission on Excellence in Education is likely to enhance student achievement. Data from the ETS Growth Study reveals that completion of the core curriculum has sizable effects on senior-year test performance, even when…

Perspectives are provided to help evaluators of health promotion programs. Eight papers present critical issues in such evaluations, including: (1) conceptual themes of program theory and context; (2) topics related to measurement, data analysis, and research design; and (3) reports of evaluation studies. (SLD)