Elicited imitation (EI) has been widely used to examine second language (L2) proficiency and development and was an especially popular method in the 1970s and early 1980s. However, as the field embraced more communicative approaches to both instruction and assessment, the use of EI diminished, and the construct-related validity of EI scores as a…

A synthesis of the state of the literature is discussed in this section of the Evaluation Capacity Building (ECB) forum organized around four critical questions: (1) What is ECB? (2) How can we make it happen? (3) How do we know it is happening? and (4) What is its impact? The authors argue that to move the field of ECB forward we need to envision…

This article illustrates how organizational theory can be used to support the development of authentic assessment practice among community college faculty, as well as guide research on implementation of assessment efforts. While many factors make implementing assessment difficult, the link between accreditation and assessment is a key element in…

Jill Chouinard, in her article "The Case for Participatory Evaluation in an Era of Accountability" (this issue, p. 237), may be re-iterating what has often been claimed and arguably is infused already in much of our theory and practice: the value of participatory approaches in some, perhaps many situations. She summarizes these claims eloquently…

This article contributes to the body of knowledge on teacher evaluation systems by examining the actual design and performance of new teacher-evaluation systems in four school districts that are at the forefront of the effort to evaluate teachers meaningfully. The authors find first that the ratings assigned teachers by the districts'…

Optimal assessment tools should measure in a limited time the knowledge of students in a correct and unbiased way. A method for automating the scoring is multiple choice scoring. This article compares scoring methods from a probabilistic point of view by modelling the probability to pass: the number right scoring, the initial correction (IC) and…

Latent variable structural equation modeling has become the analytic method of choice in many domains of research in psychology and allied social sciences. One important aspect of a latent variable model concerns the relations hypothesized to hold between latent variables and their indicators. The most common specification of structural equation…

Summarizing theory and results of empirical research, this article serves to illustrate why effects measured with retrospective pretests may be subject to bias and may not always be explained by response shift theory. It presents three contending theories to explain the difference between retrospective and traditional pretest results and considers…

The Labin et al. logic model describes the why, how, what, and potential outcomes of evaluation capacity building (ECB). Getting To Outcomes offers a frame and empirical results for operationalizing the ECB logic model of Labin et al. and for deepening the science and practice of ECB.

Traditionally there has been a tension between evaluation research and so-called pure research which has resulted in evaluation research seldom being recognized by the UK Research Assessment Exercises. The newly configured Research Excellence Framework (REF) will use similar criteria to judge research, notwithstanding the introduction of…

Research on evaluation has mainly focused on the use of evaluation and has given little attention to the origins of evaluation demand. In this article, I consider the question of why parliamentarians demand evaluations with parliamentary requests. Building on the literature of delegation, I use a principal-agent framework to explain the origins of…

A new approach to researching school effects on higher education participation is proposed here, which combines insights from the school effectiveness field of research with sociological theories and concepts of schooling. In doing so, it draws attention to some of the problems with the dominant approach often taken in this area and attempts to…

Over the past year, the Board of Directors of the American Evaluation Association (AEA) has been discussing ways in which AEA can strengthen its relationships and build collaborative partnerships within the international evaluation community as well as increase AEA members' awareness of and capacity to engage issues that shape evaluation…

This article illustrates how a new framework for conceptualising comparability has the potential to help assessment professionals to understand and to conduct debate on linking theory and practice. The framework was used as a lens through which to study a corpus of research reports, from which a narrative was constructed to characterise the…

The intent of this research reporting guide is to provide the field of adult and juvenile justice corrections evaluators and researchers with a template for how to write their research studies for publication in the criminal justice field. In an effort to produce similar quality research, social science researchers are trying to adopt many of the…