The six articles of this special section explore various aspects of the certification of evaluators, departing from a task force report of the American Evaluation Association that examined the potential of certifying evaluators and a survey of members of the American Evaluation Association. Articles present positions for and against evaluator…

An external evaluation documented what occurred in an inaugural summer camp to teach high school students how to preserve religious freedom by learning about and acting on the history and current state of church-state separation and other first amendment issues. Camp designers hoped to promote religious diversity values and civic engagement in…

In this paper, the authors describe the benefits and pitfalls of mixed methods designs. They argue that mixed methods designs may be preferred when evaluating professional development programs for p-K-12 education given the new call for accountability in making data-driven decisions. They summarize and critique the studies in terms of limitations…

This article presents a method for computer-aided tutor evaluation: Bayesian Networks are used for organizing the collected data about tutors and for enabling accurate estimations and predictions about future tutor behavior. The model provides indications about each tutor's strengths and weaknesses, which enables the evaluator to exploit strengths…

Helping students prepare for solo and ensemble festivals can be an arduous task for music educators. From choosing appropriate repertoire, to learning pitches, to securing accompanists, to ensuring that students understand appropriate dress and conduct, myriad details are involved in successful preparation for educational and enriching…

A critical historical review of the tensions in American governance places the method choice debate in a broader perspective. This chapter reviews the factors that influence the evaluation questions posed to evaluators and, in turn, the methods choices that stem from it. Political and professional pressures on the evaluators also influence methods…

Scant research has examined the validity of instruments that permit observer ratings of psychopathy. Using a nonclinical (undergraduate) sample, the authors examined the associations between both self- and observer ratings on a psychopathy prototype (Psychopathy Q-Sort, PQS) and widely used measures of psychopathy, antisocial behavior, and…

[Slides] presented at the American Educational Research Association (AERA) Conference in New York in March 2008. This presentation explores what cues are used as a deciding factor in essay scoring by the essay grader.

In this rebuttal to Linn's critique (see EJ802887), the authors state that, while Linn provides a thoughtful critique of the culture-centered approach by questioning its feasibility, he missed the idea that the very concept of effectiveness is brought under scrutiny by the culture-centered approach, with the focus being on examining the universal…

Methodological rigor consists of a series of elements that, in combination, determine the confidence with which conclusions can be drawn from the evaluation results. These elements include evaluation design, conceptualization of constructs, measurement strategies, time frames, program integrity, and others. The authors examine the factors that…

This dissertation addresses theory and practice of evaluation and assessment in university student affairs, by applying logic modeling/program theory to a case study. I intend to add knowledge to ongoing dialogue among evaluation scholars and practitioners on student affairs program planning and improvement as integral considerations that serve…

This study investigated the effects of teacher, self and peer evaluation on preservice teachers' performance, knowledge and attitudes. Earlier research by the same authors revealed that students made significant improvements in their lesson plans under all three of these conditions, but the teacher-evaluation improved significantly more than the…

Business schools are often criticized for the inadequate writing skills of their graduates. Improving writing skills involves first understanding the current skill level of students. This research attempts to provide insights into the effectiveness of the current method of assessing writing skills in a school of business at a large regional…

This fact sheet summarizes data gathered in the 2011 survey of National Science Foundation (NSF) Advanced Technological Education (ATE) grant recipients. Conducted by EvaluATE, the evaluation resource center for the ATE program located at The Evaluation Center at Western Michigan University, this was the twelfth annual survey of ATE projects and…

Despite increasing interest in the integration of evaluative inquiry into organizational functions and culture, the availability of empirical research addressing organizational capacity building to do and use evaluation is limited. This exploratory descriptive survey of internal evaluators in Canada asked about evaluation capacity building in the…