Evaluations of vocational education and training (VET) programs play a key role in informing training policy in Australia and elsewhere. Increasingly, such evaluations use observational data from surveys or administrative collections to assess the effectiveness of VET programs and interventions. The difficulty associated with using observational…

This study examined impact of a staff development program on increasing the accuracy of teachers' self-evaluation of classroom performance. Teachers were provided with specific formal feedback through a program called The Effective Use of Time Program (EUOT). The program had four components: (1) observation in the classroom and feedback about…

The purpose of this study was to develop and validate an observation measure designed to capture teachers' use of interactive teaching skills within the delivery of the All Stars substance use prevention program. Coders counted the number of times teachers praised and encouraged students, accepted and used students' ideas, asked questions,…

The purpose of this report was to explore one way in which quantitative and qualitative paradigms in program evaluation can be employed to reinforce each other. An evaluation was conducted of a large number of special education programs for preschoolers with handicaps in Louisiana. Since 1978, Louisiana has funded programs in 65 public school…

In 2006, more than 6 million individuals were victimized by violent crimes. Although violence is below levels of the early 1990s, it remains high. The extent of violence and its impact highlight a critical need to develop and implement effective programs to reduce violence and victimization. Communities have initiated a wide range of such…

The paper describes a naturalistic evaluation study of an enrichment program for gifted learners in Newfoundland. The pull-out program (for two half days out of six) is described in terms of audience concerns and issues, standards, program components, and data-generating techniques (observations and interviews). The evaluation led to a report…

The Service Delivery Assessment (SDA) model is a human services evaluation tool which offers a viable alternative to more traditional approaches and is appropriate for small local evaluations as well as large national studies. There are five phases to an SDA study: assignment, pre-assessment, design, analysis, and communication of the findings.…

Concurrent use of two direct observation instruments (momentary time sample of task engagement and event recording of discrete student responses) were evaluated in six middle school resource rooms using either of two reading programs. Findings tended to be program specific with differences lost or diluted when data were combined across programs.…

Since objective data on the effectiveness of self-help groups are not available, participants' views of a program's value are instructive. A study was undertaken to contrast participants' (N=232) evaluations of their self-help meetings with independent observers' (N=11) evaluations and to describe the components of their respective views in terms…

Reports on observations of the guidance and counseling services offered in nine schools in the San Francisco Unified School District, California. Provides a history of the development of these programs, discusses the role of the counselor, sets forth the expected tasks of the counselor while comparing these with the actual work being performed,…

To determine the nature of camp for senior citizens, four participant observers (staff members) conducted open-ended interviews with campers at a five-day residential camp in Oregon. Results showed universal satisfaction with the camp experience. Campers valued the wide range of activities, comfortable places to socialize, and staff relations with…

Outlines specific steps for implementing and validating a qualitative methodology designed to evaluate rural areas' special education programs serving students with severe special needs. Provides a rationale for use of the elements of aesthetic criticism as the basis of the methodology and discusses practical limitations and usefulness of the…

Quality measures were originally developed for research aimed at describing the settings that children spend time in and identifying the characteristics of these environments that contribute to children's development. They were also developed to guide improvements in practice. Increasingly, however, measures of quality are being used for further…

The theory underlying qualitative research design and a specific formative evaluation study that includes qualitative methods are discussed. The focus is the data analyses methods and procedures employed in the evaluation study, as well as the strengths and weaknesses of the inquiry. Qualitative research focuses on the idiographic and operates on…

Two different methods of collecting information about student activity in the laboratory were compared using a series of videotape recordings. One method was based entirely on the systematic observation of student behavior (interaction analysis); the second method involved students describing their laboratory activities while watching excerpts…