This article describes an evaluation method based on collaboration between the higher education, a care home and university, in a R&D project. The aim of the project was to elaborate modelling as a tool of developmental evaluation for innovation and competence in project cooperation. The approach was based on activity theory. Modelling enabled a…

To date, hardly any evidence is available on the quality of adult education programs for vulnerable adults. Evaluation instruments or models mostly focussed on regular education and less on programs of adult education aiming to enhance social inclusion. This study presents a first exploration of the construct validity of a newly developed…

Hundreds of millions of dollars in public and private funding have been spent to develop, research, and evaluate the assessment system of the National Board for Professional Teaching Standards (NBPTS). In an effort to determine if this has been money well spent, the U.S. Congress commissioned the National Research Council (NRC) to develop a…

This article focuses on school self-evaluations (SSE). It addresses whether SSE meets quality indicators and whether differences can be found between the quality judgments of school principals and inspectors. Data stem from two complementary data collections: population data of school inspections and a survey of a representative sample of school…

To what extent does the intense and direct involvement of internal stakeholders, such as program managers and staff members, play a significant role toward evaluation use? Stakeholder involvement is a key element in evaluation and evaluation use is considered within a broader sense that includes organizational knowledge, individual skills, and…

Multidimensional item response theory (MIRT) provides an ideal foundation for modeling performance in complex domains, taking into account multiple basic abilities simultaneously, and representing different mixtures of the abilities required for different test items. This article provides a brief overview of different MIRT models, and the…

This study examines why some public elementary school teachers openly refuse participation in a mandatory national, standards-based teacher evaluation program. We describe the perceptions these "rebel" teachers have of the evaluation system, studying their open resistance based on the meanings they construct, and elaborated an…

When multiple education projects operate in an overlapping or rear-ended manner, it is always a challenge to separate unique project effects on schooling outcomes. Our analysis represents a first attempt to address this challenge. A three-level hierarchical linear model (HLM) was presented as a general analytical framework to separate program…

Mathematical word problems represent a common item format for assessing student competencies. Automatic item generation (AIG) is an effective way of constructing many items with predictable difficulties, based on a set of predefined task parameters. The current study presents a framework for the automatic generation of probability word problems…

In this article, we report the results of an instrumental, mixed methods case study (Stake, 1995) of a culturally responsive school-based evaluation initiative. In studying culturally responsive school-based evaluation, we found some broader issues with school-based evaluation more generally. These challenges include what knowledge schools need to…

The purpose of this article is to describe a new approach for conducting multi-site evaluations of professional development (PD). The approach extends a popular model of PD evaluation through the creation of individual project profiles that take into account the unique contextual variables of individual projects while providing an evaluation…

Provides a conceptual framework for considering the distinction between evaluation use and evaluation influence and the relationship between evaluation use and knowledge use. Clarifies and expands some of the established definitions of concepts related to evaluation use. (SLD)

Post-graduate courses are periodically evaluated in accordance with not always very clear criteria by CAPES (Co-ordinating Committee for Teaching Staff Improvement). These criteria try to measure, among other things, academic productivity (including quantity and quality of scientific production), number of classes given by teachers, time to…

A model was developed to find out whether teachers can predict the success of their students on a specific test. Implications for curriculum development and changes in classroom instruction are discussed. (RB)

Discusses evaluation models based on the "Kernal of Truth Theory" or Metaperceptual Congruence Methodology. Relates this model to the decision-making process and to the development of ethnic stereotypes. (RB)