Comparability between different educational qualifications is an important issue within policy discourse in the UK. In this context, the comparability of qualification demands has been explored through the use of expert human judgement. The involvement of human judgement in estimating assessment demands has consequences for methodology. This…

A central task of evaluation is to use systematic inquiry to judge the merit, worth, and significance of programs. As a field in education, evaluation began to mature during the 1960s, when policy makers began funding researchers to study the impact of Great Society programs. Since that time, evaluation and policy-making have been intertwined,…

Never before in the history of the teaching profession has there been such a need for comprehensive evaluation of all teacher preparation programs, most especially professional development schools (PDSs). This need is driven not only by the pressures of the age of accountability, but also by the need for the PDS movement to act ethically and…

This paper examines the practice of metaevaluation as indicated by the Metaevaluation standard of the Program Evaluation Standards, as the evaluation of a specific evaluation to inform stakeholders about the evaluation's strengths and weaknesses. The findings from an analysis of eighteen metaevaluations, including a description of the data…

The last major review of the achievement outcomes of comprehensive school reform (CSR) models was conducted in 2003. Despite the growing evidence base supporting CSR, the program was discontinued by the federal government in 2007. Now, six years after the 2003 meta-analysis, the study's lead author, Geoffrey Borman, revisits the results and…

The purposes of metaevaluation go beyond the traditional functions of accountability and enhancement. It helps guide strategic organizational change and legitimizes evaluation systems. Metaevaluation results can also be used to create checklists so that the persons responsible for any evaluation can revise, monitor, and control them by themselves.…

With the advent of the UN Literacy Decade launched in 2003, there is increased emphasis on monitoring and evaluation of adult literacy around the globe. The present paper presents an overview of the main approaches that have been taken to measure adult literacy within and across countries. A particular focus of the present review is to compare and…

The recent "Nationwide academic achievement and study situation survey" was clearly influenced by the idea of "authentic assessment", an educational assessment perspective focused on "quality" and "engagement". However, when "performance assessment", the assessment method corresponding to this…

In this article, we introduce a person-fit statistic called the hierarchy consistency index (HCI) to help detect misfitting item response vectors for tests developed and analyzed based on a cognitive model. The HCI ranges from -1.0 to 1.0, with values close to -1.0 indicating that students respond unexpectedly or differently from the responses…

The 2007 reauthorization of the No Child Left Behind Act in the United States has provided additional incentive to sustain attention on this law. Based on a review of the literature, this article highlights some objectives of the act and identifies shortcomings associated with the type of assessments the act endorses. Because these assessments…

Purpose: The quality of an education system or a comparative international assessment refers more and more to quantitative parameters, i.e. "educational indicators." The paper aims to analyse the structure of several educational indicators and indicator systems and answer the question "What can educational indicators achieve?"…

An assessment framework is like a blueprint, laying out the basic design of the assessment by describing the mathematics content that should be tested and the types of assessment questions that should be included. It also describes how the various design factors should be balanced across the assessment. This is an assessment framework, not a…

This special series focused on treatment integrity in the child mental health and education field is timely. The articles do a laudable job of reviewing (a) the current status of treatment integrity research and measurement, (b) existing conceptual models of treatment integrity, and (c) the limitations of prior research. Overall, this thoughtful…

Higher education institutions (HEIs) have experienced increasing pressures to provide accountability data and consumer information on the quality of teaching and learning. Existing ratings and rankings of HEIs tend to neglect information on student learning outcomes. Instead, they focus on inputs, activities and research outputs, such as resources…

This document was developed by the Mid-South Regional Resource Center (MSRRC) and is designed to be used as an assessment of State systems by State Part B and Part C staff and their stakeholders. It provides a detailed process for State Education Agencies (SEA) and Lead Agencies (LA) to follow that will guide improvement efforts relative to the…