Researchers have explored a variety of topics related to identifying and distinguishing among specific types of rater effects, as well as the implications of different types of incomplete data collection designs for rater-mediated assessments. In this study, we used simulated data to examine the sensitivity of latent trait model indicators of…

Collaborative Evaluation systematically invites and engages stakeholders in program evaluation planning and implementation. Unlike "distanced" evaluation approaches, which reject stakeholder participation as evaluation team members, Collaborative Evaluation assumes that active, on-going engagement between evaluators and program staff,…

This engaging text takes an evenhanded approach to major theoretical paradigms in evaluation and builds a bridge from them to evaluation practice. Featuring helpful checklists, procedural steps, provocative questions that invite readers to explore their own theoretical assumptions, and practical exercises, the book provides concrete guidance for…

As Americans shift their work and leisure activities online, Extension seeks to remain viable by delivering programs through a website known as eXtension. eXtension is predicated on the voluntary labor of Extension specialists and educators who form Communities of Practice to create and deliver content through the website. Evaluation of eXtension…

This article describes an evaluation that was judged to be unsuccessful from the point of view of key program stakeholders. This was due to the fact that the evaluation did not support program advocates who had much to gain from positive evaluation findings. We argue that, although the knowledge needs of stakeholders must be taken into account,…

The use of theory-driven evaluation is an emerging practice in the military--an aspect generally unknown in the civilian evaluation community. First developed during the 1991 Gulf War and applied in both the Balkans and Afghanistan, these techniques are now being examined in the North Atlantic Treaty Organisation (NATO) as a means to evaluate the…

The Office of Planning, Research and Evaluation (OPRE), a unit within the Administration for Children and Families (ACF), is responsible for advising the Assistant Secretary for Children and Families on increasing the effectiveness and efficiency of programs to improve the economic and social well-being of children and families. In collaboration…

Program theory and implementation process theory contribute, respectively, to specifying the what and the why of program delivery. This article discusses the relationship between these two theories and the types of data collection methods that can be derived from each in order to contribute to more comprehensive evaluation designs. (JAZ)

The validity of vignettes used to elicit subject responses in social science research is examined in a study of the validity of a group of patient assault vignettes seen by 12 persons with experience in patient care. A model for establishing the validity of vignettes is proposed. (SLD)

Using examples from an evaluation design of a bilingual preschool program, the authors have developed a paradigm resting on contextually based evaluation and involving implementation strategies and participant researchers. Multiple methods of gathering environment-specific data are used in the process. (MH)

Personnel at Saint Louis University's Department of Education have been theorizing, researching, and enlarging an approach to program evaluation that focuses heavily on the place of values in making judgments. This work originally stemmed from general curriculum evaluative theory developed by James H. McElhinney and Richard C. Kunkel. The content…

The Judicial Evaluation Method (JEM) is useful for aiding decision-making bodies to formulate policies. Broad public participation in complex issues is provided by JEM. (The conceptualization, policy formulation stages, and participant roles are identified; and the model is applied in two case studies). (MH)

The checklists, tips, and examples will help persons involved with youth participation projects demonstrate the impact of a project. They will also help check for project strengths and weaknesses. Including the introduction, there are seven chapters. Chapter 2, "How Should Your Evaluation Look?" discusses what questions should be asked,…

The Minneapolis Experimental Schools Project (Southeast Alternatives)--a five-year program established in 1971 to test comprehensive change in education--enrolls 2,200 K-12 students, approximately 4% of the public school population. Southeast Alternatives (SEA) is dedicated to four major goals: (1) to provide a curriculum which helps children…

Designed for use by institutions at the postsecondary level, this program evaluation package contains instructions for planning and implementing an evaluation program, instruments for obtaining information from key sources, and procedures for their use. Covered in the individual chapters are the following topics: an overview of evaluation…