Comparative judgment is gaining popularity as an assessment tool, including for high-stakes testing purposes, despite relatively little research on the use of the technique. Advocates claim two main rationales for its use: that comparative judgment is valid because humans are better at comparative than absolute judgment, and because it distils the…

Various instruments that have the aim of assessing children even from a very young age are constantly being developed. We argue that these instruments and assessment processes risk removing judgement from educators and teachers. Using the Aristotelian concept of "phronêsis," we argue that teachers need to develop a habit of engaging with…

When individuals have questions about scientific issues, they often search the Internet. Evaluating sources of information and claims they find has become more difficult in the post-truth era. Students are often taught source evaluation techniques, but the proliferation of "fake news" has resulted in a misinformation arms race. As…

The chapter explores critical roles of internal evaluators in contemporary organizational settings. The need is highlighted for an expanded, reconfigured, unorthodox set of roles and styles of work to meet the needs of the emerging learning organizations effectively. A discussion of major categories of internal evaluator roles emerged from the…

Vocational psychology has generated a number of concepts and assessment instruments considered to reflect ability self-concept (i.e., one's view of one's own abilities) relevant to career development. These concepts and measures often are categorized as either self efficacy beliefs or self-estimated (i.e., self-rated, self-evaluated) abilities.…

Techniques developed in a federal agency to forge links between evaluators and decision makers using evaluation information are described. Focus is on engaging the decision maker in the identification of candidate programs, selection among candidates, program evaluation, reporting of evaluation results, and assessment of evaluation impact. (SLD)

Evaluation research is conceived as a question answering process. Four strategies are suggested which emerged from four approaches to the study of questions. Evaluation questions must be identified and classified before research can effectively begin. This paper discusses the four approaches to studying evaluation research questions and their…

The Internet is a significant information resource for students due to the ease of access it allows to a vast amount of information. As the quality of the information on the Internet varies, it is important that students are able to evaluate such information critically. The aim of the study was to investigate how students evaluate Internet sources…

Theories or explanations of educational evaluation are discussed and categorized under two broad methodological headings, the objectivist and subjectivist epistemological orientations. They can be seen as potentially complementary empirical approaches that offer evaluators two methodological orientations to assess educational-reform outcomes.…

Utilizing social judgment theory, a method for eliciting opinions about the relative importance of multiple objectives, a model was developed to evaluate the performance of public agencies and programs. The model was then applied to the problem of establishing relative weights for six performance dimensions for a public agency. (Author/EGS)

It is assumed that evaluators of the future will still be interested in case study methodology. Scenarios that ignore a case study method, that look back to a distinctive case study method, and that see the case study method as an integrating force in the qualitative-quantitative debate are explored. (SLD)

The accuracy of standards obtained from judgmental methods is dependent on the quality of the judgments made by experts throughout the standard setting process. One important dimension of the quality of these judgments is the consistency of the judges' perceptions with item performance of minimally competent candidates. Several interrelated…

Despite the critical importance of maintaining a valid and transparent selection process that serves the values held by all stakeholders involved in medical education (i.e., students, faculty, society), there continue to be problems with the current state of available admissions protocols. Some problems derive from inertia induced by inaccurate…

The relationship between argumentation and informal reasoning is discussed, followed by a consideration of instructional factors that influence argumentation performance. An account of one expert student reasoner is provided. Instruction in argumentation is reviewed, and suggestions are made for argumentation based on classroom experience. (SLD)

This paper discusses evaluation design considerations for a computer based evaluation simulation developed at the University of Iowa College of Medicine in Cardiology to assess the diagnostic skills of primary care physicians and medical students. The simulation developed allows for the assessment of diagnostic skills of physicians in the…