We reviewed 13 studies that focused on analyzing student errors on achievement tests from the Kaufman Test of Educational Achievement-Third edition (KTEA-3). The intent was to determine what instructional implications could be derived from in-depth error analysis. As we reviewed these studies, several themes emerged. We explain how a careful…

This paper explores multilevel modeling approaches for 2-group randomized experiments in which a treatment condition involving clusters of individuals is compared to a control condition involving only ungrouped individuals, otherwise known as partially nested cluster randomized designs (PNCRTs). Strategies for comparing groups from a PNCRT in the…

This sequential mixed methods study analyzed how program evaluation was used to assess educational administration and examined thematic trends in educational evaluation published over 10 years (2001-2010). First, qualitative content analysis examined the articles in eight peer-reviewed evaluation journals. This analysis revealed that numerous…

We estimated the invariance of educational achievement (EA) and learning attitudes (LA) measures across nations. A multi-group confirmatory factor analysis was used to estimate the invariance of educational achievement and learning attitudes across 55 nations (Programme for International Student Assessment [PISA] 2006 data, N = 354,203). The…

When examining various evaluation prescriptive theories comparatively, we find it helpful to have a framework showing how they are related that highlights features that distinguish theoretical perspectives, thus a "theory" about theories. The evaluation theory tree that we presented in Alkin's recent book, "Evaluation Roots"…

When comparing data derived from tests or questionnaires in cross-national studies, researchers commonly assume measurement invariance in their underlying scaling models. However, different cultural contexts, languages, and curricula can have powerful effects on how students respond in different countries. This article illustrates how the…

The Approaches to Teaching Inventory (ATI) is used to examine teachers' teaching approaches in higher education. Analyses into the validity and reliability of the original English ATI yielded positive results. In this study, we examined the degree to which these positive results can also be found for the Dutch version that we developed. Data were…

This study compares three variations in how researchers construct middle childhood social networks: (1) with "friendships" or "affiliations" as a relational tie; (2) with children providing "self reports" of relationships, or in addition, "multi-informant reports" of relationships in which they are not involved; and (3) whether network computation…

Characterising the relationship between participants' scores on two different questionnaires is a common problem in educational research. The complement of the statistic known as Wilks' lambda measures the amount of variance shared between the scores obtained by the same group of participants on two sets of variables. (1 - lambda) is symmetric, in…

Several current international comparative large-scale assessments of educational achievement (ICLSA) make use of "Rasch models", to address functions essential for valid cross-cultural comparisons. From a historical perspective, ICLSA and Georg Rasch's "models for measurement" emerged at about the same time, half a century ago. However, the…

Background Context: In most immigrant-receiving societies, an important question, both for researchers and policy makers, has been the weighing of the relative efficiency of different formulas in the learning of the host language by immigrant students, especially the potential impact of specific services on social integration and the role of…

What do Elliot Eisner's discussions of objectivity mean for the strength of the link between consistency and truth in educational research? Following his lead, I pursue this question by comparing aspects of qualitative educational research with appraising the arts. I argue that some departures from the highest levels of consistency in assessing…

This article is a reflection on an area of particular interest in the current research environment, but which has not yet been explored satisfactorily in the education literature: the evaluation of educational research. The particular focus is on the UK context, but the article is informed by comparative evidence from six countries (gathered…

Education researchers, practitioners, and policymakers alike are committed to identifying interventions that teach students more effectively. Increased emphasis on evaluation and accountability has increased desire for sound evaluations of these interventions; and at the same time, school-level data have become increasingly available. This article…

This article is a response to "Mapping educational research and its impact on Australian schools," Chapter 2 of The Impact of Educational Research, in which researchers Allyson Holbrook, John Ainley, Sid Bourke, John Owen, Philip McKenzie, Sebastian Mission and Trevor Johnson report on their Commonwealth Education Department commissioned…