This document is one of a series of reports which describe the experiences of six state agencies that are developing systems to affect the development and implementation of policy in the federal/state program for vocational rehabilitation. The state programs are developing model program evaluation/management information support units. This second…

The Hofstra University program in applied research and evaluation in psychology is described as an example of one model for training evaluators. The training of psychologists with a specialization in evaluation research is reviewed, and the pros and cons of evaluation research training within psychology are discussed. Several potential benefits of…

A theoretical model and a case study are described to support the premise that the ideological levels of members of a social change project must be identified in order to assess their potential for inducing change and to evaluate that change. A conceptual model of the development of a social justice ideology is formulated, and is described as…

Triton College's proposed method of conducting periodic comprehensive evaluations of the quality and potential of its academic programs has five components. First, a self-study is conducted by the faculty and administrators of the program being reviewed, in a year-long comprehensive examination of the program. Second, an external consultant, with…

As an introduction to the Program Evaluation Kit, this handbook serves as a general guide for the evaluator and provides a directory to the rest of the series (TM 008 703-710). Chapter 1 discusses the critical issues in program evaluation. Chapter 2 describes the diversified job of the evaluator. Chapters 3 through 5 contain step-by-step guides…

The Hawaii Vocational Assessment Research Project has proposed a three stage analysis procedure that helps school districts to assess the impact of vocational assessment on vocational program content, the decision-making process, and the format in which vocational assessment is presented. (CB)

Background: Teacher education programs in the State of California are increasingly held accountable for the assessment of teacher candidates' competencies and performance. One salient assessment tool is the utilization of portfolios in teacher education programs (Wolf, 1989; 1991). Among the newest and most innovative templates of portfolios in…

Effects of an applicant's information management strategy while responding to a job application item requesting illegal candidate information and moderating effects of applicant sex and position were studied for 12 hypothetical school job applicants with 108 graduate student raters. The interactions of strategy, sex, and position have important…

Two studies involving 135 female and 21 male undergraduates compare effects of masculinity and femininity on rater and ratee evaluations of emergent leader behavior in mixed-sex and same-sex groups. Masculinity is not associated with peer-rated leadership, but femininity is correlated with two measures (self-task and self-relationship) of…

The effectiveness of alternative procedures to correct for rater leniency/stringency effects was studied when true scores were known. Ordinary least squares, weighted least squares, and imputation of the missing data consistently outperformed averaging the observed ratings; and the imputation technique was superior to the least squares methods.…

Major findings from a five-year study of the impact of the Swedish School Leader Education Program (SLEP), a program of leadership development for principals and vice principals, are reported. Despite research design difficulties, results for 35 school management areas and 66 evaluators suggest a positive impact of the SLEP. (SLD)

Difficulties faced in evaluations that include data in a language not native to the evaluators or that lie outside the evaluators' cultural experience are discussed. Improvements to credibility and fairness from using a cross-cultural, bilingual evaluation are described and illustrated through evaluation of a language immersion program in Hawaii.…

The status of formal recommendations is different in the naturalistic evaluation model than in the traditional empirical model. The evaluation of a high school peer support program for alcohol abuse prevention illustrates that reader-generated recommendations may have more usefulness and impact than do evaluator-generated ideas. (SLD)

This research focuses on the examination of problems related to the national teacher performance appraisal system by the Thai Ministry of Education. It highlights major problems of the current performance appraisal system by delineating the weaknesses and pitfalls of the current appraisal system. The findings indicate problems to three major…

The increasing availability and performance of computer-based testing has prompted more research on the automatic assessment of language and speaking proficiency. In this investigation, we evaluated the feasibility of using an off-the-shelf speech-recognition system for scoring speaking prompts from the LanguEdge field test of 2002. We first…