In this paper, we examine the validity and precision of two nonexperimental study designs (NXDs) that can be used in educational evaluation: the comparative interrupted time series (CITS) design and the difference-in-difference (DD) design. In a CITS design, program impacts are evaluated by looking at whether the treatment group deviates from its…

The International Association for the Evaluation of Educational Achievement (IEA) has been conducting comparative studies for 50 years. SITES 2006 is the fifth wave of surveys related to information and communication technology (ICT), a wave that IEA started with its Computers in Education Study (two studies with data collection in 1989 and 1992),…

This investigation examines two contrasting evaluations of early childhood education: the Westinghouse-Ohio University study and the Ypsilanti Perry Preschool Project. The Westinghouse study concluded that Head Start experience had very little, if any, academic value for participating children, whereas the Perry Preschool Project concluded that…

Different methodologies for linking tests across languages are reviewed and evaluated, focusing on monolingual item response theory, bilingual group designs, and matched monolingual group designs. These methods, although not without weaknesses, are superior for promoting score comparability than methods that rely on translation or expert judgment…

Discussed are the assumptions which underpin research studies of the effects of pupil, school, and local education authority characteristics on student achievement in Great Britain. The purpose is to clarify the necessary limitations on knowledge imposed by various research methods and to suggest how these might be improved. (RM)

Use of performance gaps analysis in program evaluation is examined by analyzing and critiquing the gap reduction design as an experimental design and an analytic tool in program outcome evaluation. The example of the Bilingual Education Evaluation System illustrates the contention that disadvantages of the method outweigh its contributions. (SLD)

Suggestions, based on the experience of researchers at Oak Ridge (Tennessee) Associated Universities (ORAU), are offered on how evaluations in which true experimental designs are not possible can be designed for meaningful comparison. The ORAU conducts evaluation and assessment studies of educational programs intended to explore some aspect of the…

The National Assessment of Educational Progress (NAEP) is compared to the two studies of the National Educational Longitudinal Studies (NELS) Program--the National Longitudinal Study of the Class of 1972 (resurveyed in 1973, 1974, 1976, and 1979) and the 1980 High School and Beyond study (partially resurveyed and retested in 1982). The third phase…

A study compared the benefits of using the Hewlett-Packard HP-41CV hand-held computer, as opposed to conventional training without computers, in teaching mathematics to fire control systems repairers. Thirty soldiers in a course to train fire control systems repairers received training in technical mathematics using the hand-held computer, whereas…

A multiple-indicator and multiple-design approach for evaluating the quality of basic skills programs in reading, writing, and mathematics that has been implemented within a statewide system of higher education in the southeastern United States was assessed. Several of the evaluation methodologies are compared in order to determine whether results…

This volume contains 14 papers from international sources that outline fundamental concepts and research interests connected to the measurement of quality in postsecondary education. Some of the papers consist of concept papers and others are more extensive reports of research underway or findings from recently concluded studies. The papers are as…