In this article, the author shares his comments on statistical analysis for multisite trials, and focuses on the contribution of Stephen Raudenbush, Sean Reardon, and Takako Nomi to future research. Raudenbush, Reardon, and Nomi provide a major contribution to future research on variation in program impacts by showing how to use multisite trials…

In a series of reforms started in 1998 and formalized with the 2000 introduction of the Blueprint for Student Success, the San Diego Unified School District (SDUSD) implemented a wide-ranging series of reforms designed to boost the literacy skills of students. This article provides an overview of the reforms, assesses the contributions made by the…

Introspective interviewing can often determine the magnitude of relations more meaningfully than statistical analysis. Deduction from empirically validated premises avoids many research design problems. Guesswork can be combined with sensitivity analysis to determine the effects of guesses and missing information on conclusions. (Author/DWH)

Based on an independent analysis of the data used to evaluate the Developmental Economic Education Program, questions are raised about the methodology and conclusions reached by Walstad and Soper in an article published in the Winter 1982 issue of the Journal. The original study is also defended in two replies. (Author/RM)

The family unit has become the focus for policy planning, program evaluation, and research. The data series published by the Bureau of Labor Statistics permits policymakers and planners to address social and economic issues affecting families on a more timely basis. (JOW)

A representative sample of studies drawn from the published program evaluation literature is examined. It is concluded that weak designs, low statistical power, ad hoc measurement, and neglect of treatment implementation and program theory characterize the state of the art in program evaluation. (Author/BS)

Qualitative evaluation and quantitative evaluation are discussed, examining how the perspective of each can and should create a critical debate that encourages inquiry instead of hostility. To achieve the major goal of linking evaluation information to the organization's culture, the evaluator needs to use multiple methods in a responsive,…

Using the 1995 National Research Council ratings of doctoral programs in 41 fields, a statistical methodology is offered for assessing how measures of program size, faculty seniority, faculty research productivity, and faculty productivity in producing doctoral degrees influenced raters' decisions. Then using data for one field, economics,…

Evaluation of campus activities is essential if the programs are to be justified, credited, or improved. Formal qualitative evaluations can provide a wealth of information beyond what could be obtained from traditional quantitive approaches. (Author/MLW)

The future of program evaluation is bright if evaluators do not ignore their roots in quantitative research. The current interest in qualitative approaches and the call for a "fourth generation" in evaluation should not override training in quantitative research. Qualitative research should complement, rather than replace, traditional…

Demonstrates how alumni research can be designed to focus program assessment on student outcomes and be responsive to program goals, administrators' policy concerns, faculty instructional values, and professional practice standards. Based on study of 347 teacher education master's degree recipients, the paper presents a conceptual framework and…

Two frameworks for educational assessment distinguished, which is quantitative, adequate for construing some kinds of learning, and qualitative, which is more appropriate for most objectives in higher education. The paper argues that institutions implicitly encourage quantitative assessment, thus encouraging a surface approach to learning although…

Information on institutional research, planning, and evaluation is provided in 15 conference presentations. The papers included in the collection are: (1) "The Nature of Institutional Research in the Community College (CC)" by James L. Wattenbarger; (2) "The Range and Organization of Data for Research" by Richard L. Alfred; (3) "Research Methods…

The state-of-the-art in 10 areas of institutional research is considered in this collection of 10 articles. Of concern are: student attrition and retention, academic program evaluation, financial issues and economic impacts of higher education, institutional self-study and regional accreditation, peer studies of institutions, statistical packages…

This essay deals with a series of methodological issues involved in assessing training priorities in developing countries. It is argued that the present methods of arriving at these priorities leave much to be desired, and a number of suggestions are made that might lead to more informed policy decisions on education and training. (CT)