Replication is a foundation of the development of a knowledge base in an evidence-based field such as education. This study includes two direct replications of Hosp, Hensley, Huddle, and Ford which found evidence of criterion-related validity of curriculum-based measurement (CBM) for reading and mathematics with postsecondary students with…

The challenge of supporting the development of meaningful learning is prevalent in chemistry education research. One of the core activities used in the learning process is assessments. The aim of this paper is to illustrate how the semantics dimension of Legitimation Code Theory can be a helpful tool to critique the quality of assessments and…

The existing gap between research and practice in language testing has posed a huge challenge to language teachers. In particular, this study intended to examine language testing research and classroom testing activities for their degree of interaction from Iranian EFL teachers' points of view. The analysis drew on the questionnaire developed by…

The Thomas B. Fordham Institute has released a report, "Evaluating the Content and Quality of Next Generation Assessments," ostensibly an evaluative comparison of four testing programs, the Common Core derived SBAC and PARCC, ACT's Aspire, and the Commonwealth of Massachusetts' MCAS. Of course, anyone familiar with Fordham's past work…

This presentation reports the results from a three year research project examining evaluation capacity building in a complex adaptive system (CAS) and using CAS as a lens for the analysis. The NSF funded Complex Adaptive Systems as a Model for Network Evaluations (CASNET) project provides new insights on (1) the implications of complexity theory…

This paper reports on what has happened since Elliott ("Dynamic Assessment in Educational Settings: Realising Potential," 2003) in those applications of dynamic assessment that he considered. There continues to be two broad applications, one, largely researcher led, and the other, largely practitioner led, although there are examples of…

Several large scale assessments include student, teacher, and school background questionnaires. Results from such questionnaires can be reported for each item separately, or as indices based on aggregation of multiple items into a scale. Interpreting scale scores is not always an easy task though. In disseminating results of achievement tests, one…

This chapter explores the opportunities and challenges of using direct methods to measure co-curricular learning.

In the vast evaluation literature, there are numerous accounts describing the emergence of the field of evaluation. However, texts on evaluation history often describe how structural conditions for conducting evaluation have changed over time, often from an American perspective. Inspired by the Oral History Team, the purpose of this article is to…

Researchers who need to explain treatment effects to laypeople can translate Cohen's effect size (standardized mean difference) to a common language effect size--a probability of a random observation from one population being larger than a random observation from the other population. This common language effect size can be extended to represent…

Typically authors explain how they conduct interpretative phenomenological analysis (IPA), but fail to explain how they ensured that their analytical process was trustworthy. For example, a minority mention that they 'reached consensus' after having engaged in a shared analysis of the data, but do not explain "how" they did so. In this…

We summarize the history of the development of the Teacher Behavior Checklist and review examples of its utility for studying excellence in teaching across cultures and contexts.

This issue of "American Journal of Evaluation" presents commentaries by evaluation leaders, George Grob and Rakesh Mohan, which draw upon their wealth of practical experience to address questions about evaluator advocacy, including What is meant by the word "advocacy"? Should evaluators ever advocate? If so, when and how? What…

Due to the unprecedented COVID-19 incident, basic education institutions have faced different challenges in their teaching-learning activities. Particularly conducting assessments remotely during COVID-19 has posed extraordinary challenges for basic education institutions owing to lack of preparation superimposed with the inherent problems of…

University rankings have raised huge interest in the social sciences because of their methodological foundations and impact. Rankings have also gained popularity in the media system. In this article we analyze the coverage offered by the media to the Italian Research Evaluation exercise--VQR 2004-2010. Even though this evaluation did not have…