One of the themes of current school evaluation research and debate is the extent to which it is possible to integrate internal and external evaluation and accountability and improvement. In this article, the author outlines how New Zealand has attempted to reconcile these differing perspectives and aims. New Zealand has a national system of school…

Recently, there have been advances in the development of multidimensional poverty measures. Work is needed however on how to implement such measures. This paper deals with the process of selecting dimensions and setting weights in multidimensional poverty measurement using qualitative and quantitative methods in a participatory framework. We…

Maintaining comparability of test scores is a major challenge faced by testing programs that have almost continuous administrations. Among the potential problems are scale drift and rapid accumulation of errors. Many standard quality control techniques for testing programs, which can effectively detect and address scale drift for small numbers of…

This study is part of a larger research project originally funded by the Write Now CETL looking at assessment, marking and feedback from the lecturers' perspective. Earlier findings have suggested that with new lecturers at least, there are some discipline differences in how able they feel they can put into practice what they have learned about…

Extant between 2004 and 2011, Aimhigher was the UK government's flagship national initiative for widening participation to higher education for young people from disadvantaged social groups, with costs approaching 1 billion British Pounds. Its demise was predicated on a perceived lack of progress and the absence of compelling evaluative research.…

There is perhaps no subject more contentious in schools than assessment and yet, often, at classroom, school and national level, inferences and decisions are made without much reference to research in this area. In fact, teachers often accept or interpret assessment requirements without question, feeling that assessment has to be approached in a…

This paper explores multilevel modeling approaches for 2-group randomized experiments in which a treatment condition involving clusters of individuals is compared to a control condition involving only ungrouped individuals, otherwise known as partially nested cluster randomized designs (PNCRTs). Strategies for comparing groups from a PNCRT in the…

The domain of outcome research is enormous and the consequences weighty. Ethical, practical, and political goals of evaluation have insured a multitude of outcome studies concerning social, behavioral, and educational interventions as well as critiques thereof and descriptions of how to conduct related research. We have a rich literature guiding…

A sample of educational evaluators was asked to design an outcomes-focused evaluation of a school program that aims to improve the academic achievement and self-esteem of students. Evaluators provided detailed descriptions of their evaluation design and methodology in their responses. These descriptions were coded and analyzed to determine the…

We present results from a course, "Informal Science Education for Scientists: A Practicum," co-taught to graduate students in STEM-related fields by a scientist/engineer and a social scientist/humanist. This course provides a structured framework and experiential learning about informal science education during a semester-long experience. The data…

Compared to traditional test theory, where person measures are typically referenced to the distribution of a population, item response theory allows for a much more meaningful interpretation of measures as they can be directly compared to item locations. However, Stephen Humphry shows that the crucial role of the unit of measurement has been…

Evidence from recent research suggests that in the UK the public perception of errors in national examinations is that they are simply mistakes; events that are preventable. This perception predominates over the more sophisticated technical view that errors arise from many sources and create an inevitable variability in assessment outcomes. The…

Meta-analysis is the statistical analysis of a collection of analysis results from individual studies, conducted for the purpose of integrating the findings. Structural equation modeling (SEM), on the other hand, is a multivariate technique for testing hypothetical models with latent and observed variables. This article shows that fixed-effects…

This "Research Commentary" explores the roles of theoretical and empirical work in the development of productive lines of research by elaborating on 3 main points. First, the dialectic between theory and empirical practice is highly productive for both: Theory is enriched by close attention to data, and one's understanding of empirical issues is…

This paper was designed to explore the means in the field of observing classroom teaching/learning from both a general, and an "English as a Foreign Language" (EFL), viewpoint. The aim was to browse the relevant literature, and lead to consider observation tools which might serve to research in EFL. This paper summarizes the reading by…