Over the past few years, the focus group method has assumed a very important role as a method for collecting qualitative data in social and behavioural science research. This article elucidates theoretical and practical problems and prospects associated with the use of focus groups as a qualitative research method in social and behavioural science…

This paper describes the analysis of the National Science Foundation (NSF) Math and Science Partnership (MSP) program's January 2008 Learning Network Conference (LNC). This study focuses on the methodologies used by the MSP community to generate evidence and seeks to understand topics of interest to the 320 LNC participants. The data set for this…

A study examining the evaluation components of merit pay programs in Illinois suggests that such components significantly influence a program's success or failure. Merit pay programs should incorporate evaluation systems tht emphasize their formal purpose, target variables related to effective teaching, and utilize sound data collection…

Discusses problems encountered in evaluating a mass drug education program including instrument selection, logistical constraints, and data analysis. Offers suggestions as to program evaluation improvement. (Author/RC)

Analyzes data from a juvenile diversion program which seem to indicate that as program services increased, the likelihood of participant recidivism increased. Maintains that the unexpected findings resulted from flaws in data recording within the program and suggests that program designs should incorporate evaluation strategies in order to ensure…

When different individuals operating in different contexts implement similar innovations, they approach the various parts of the innovation in different ways. When assessed according to the research procedures used to study innovation implementation at the Research and Development Center for Teacher Education at the University of Texas at Austin,…

Distortion and selective disclosure limit data that are available to program evaluators, producing a bias that tends to maintain the status quo. Paradoxically, attempts to objectify the data only increase the potential for distortion. Ironically, one way to encourage innovation may be to not measure it. Additional solutions are suggested.…

Many problems are encountered when evaluating a complex, decentralized national program such as 4-H. Good effects of the federal evaluation mandate include local concern with program quality. Bad effects include that local agencies are forced to utilize noxious methodologies or to collect information they consider to be unimportant. (Author/GC)

The General Accounting Office reviewed the Department of Labor's process for determining worker eligibility for the Trade Adjustment Assistance (TAA) program. TAA provides help in making the transition to new employment to workers certified by the Department of Labor as affected by imports. The program gives workers job counseling, occupational…

Third in a series, the monograph summarizes the key evaluation issues, design approaches, and statistical techniques used in conducting the 1980-1983 impact evaluation of Indian Education Act Title IV Part A programs. The monograph describes the major problems in evaluating the program to determine the degree of its positive contribution to…

Evaluators often utilize analysis of covariance (ANCOVA) techniques to compensate statistically for the lack of experimental control when assessing the effects of innovative programs implemented in naturalistic settings. In this paper design, analysis, and reporting considerations important to the application of ANCOVA-type techniques in…

This chapter presents a number of problems related to designing local-level summative evaluation studies and suggests solutions to these problems. Three general areas are covered. First, many of the motivational, organizational, and attitudinal constraints likely to face the local-level evaluator are discussed. Second, various threats to the…

Strasser and Deniston's own analysis (TM 504 254) shows that post-planned evaluations are unsuitable substitutes for pre-planned evaluations. When viewed as post-experimental interviews, however, post-planned evaluations can produce valuable information which complements traditional experimental and quasi-experimental evaluations. (MH)

A longitudinal study was planned to track a class in a prekindergarten program to determine program effectiveness. There are many problems in conducting a longitudinal study, most of which revolve around the long-term commitment required. A carefully designed information system is important. For the study in question, computer software and…