Korea has used three different teacher evaluation systems since the 1960s: teacher performance rating, teacher performance-based pay and teacher evaluation for professional development. A number of studies have focused on an analysis of each evaluation system in terms of its advent, development, advantages and disadvantages, but these studies have…

This paper is meant to highlight the occurrence of Simpson's Paradox when using aggregated data obtained from two IEA studies in Israel, while ignoring the effect of a powerful intervening variable in the local context--the ethnicity factor. It will demonstrate faulty conclusions regarding either the absence of relationships between a contextual…

Background/Context: Two key uses of international assessments of achievement have been (a) comparing country performances for identifying the countries with the best education systems and (2) generating insights about effective policy and practice strategies that are associated with higher learning outcomes. Do country rankings really reflect the…

Humphry (this issue) has written a thought-provoking piece on the interpretation of item discrimination parameters as scale units in item response theory. One of the key features of his work is the description of an item response theory (IRT) model that he calls the logistic measurement function that combines aspects of two traditions in IRT that…

Child assessment practices in English and Korean preschools were compared by analysing data from interviews with educators, examples of child assessment, and official documents from each country. Child assessment in England was systematically implemented and characterised by several methodological and procedural strengths, whereas assessment in…

Cognitive ability tests are widely used in organizations around the world because they have high predictive validity in selection contexts. Although these tests typically measure several subdomains, testing is usually carried out for a single subdomain at a time. This can be ineffective when the subdomains assessed are highly correlated. This…

In the last four years McKinsey and Company have produced two highly influential reports on how to improve school systems. The first McKinsey report "How the world's best-performing school systems come out on top" has since its publication in 2007 been used to justify change in educational policy and practice in England and many other…

In attempting to use a realistic evaluation approach to explore the role of Community Parents in early parenting programs in Toronto, a novel technique was developed to analyze the links between contexts (C), mechanisms (M) and outcomes (O) directly from experienced practitioner interviews. Rather than coding the interviews into themes in terms of…

This study looks at the fairness of assessing learning journals both as the fairness in creating a valid and robust marking process as well as how different student groups may have unfair disadvantages in performing well in reflective assessment tasks. The fairness of a marking process is discussed through reflecting on the practical process and…

In high-stakes writing assessments, rater training in the use of a rating scale does not eliminate variability in grade attribution. This realisation has been accompanied by research that explores possible sources of rater variability, such as rater background or rating scale type. However, there has been little consideration thus far of…

This paper addresses a key methodological challenge in the modeling of individual poverty dynamics--the influence of measurement error. Taking the US and Britain as case studies and building on recent research that uses latent Markov models to reduce bias, we examine how measurement error can affect a range of important poverty estimates. Our data…

Statewide exit examinations play an important role in discussions on school effectiveness. Referring to educational governance concepts, this paper presumes a relation between varying organizational structures of statewide examinations across states, and heterogeneous effects on school actors. It is assumed that their ability to affect work in…

This report critically examines studies of how scientific research drives innovation which is then translated into socio-economic benefits. It focuses on research evaluation insights that are relevant not only to the academic community, but also to policymakers and evaluation practitioners--and particularly to biomedical and health research…

This paper examines the current academic and policy literatures concerning school evaluation in primary and secondary education within the OECD countries. First, it provides a typology of the existing systems of school evaluation across the OECD. It encompasses the diverse criteria and instruments commonly used to carry out schools evaluation, as…

Comments on findings from a European survey of graduate employment and illustrates the difficulty of trying to make international comparisons of higher education's contribution to employability. Suggests that comparison within the United Kingdom is also problematic and provides evidence of the impact of factors outside higher education's control.…