This paper scrutinizes the increasing trend of using international large-scale assessment (ILSA) data for causal inferences in educational research, arguing that such inferences are often tenuous. We explore the complexities of causality within ILSAs, highlighting the methodological constraints that challenge the validity of causal claims derived…

Empirical research on teachers' professional knowledge is mostly conducted worldwide with reference to the construct 'pedagogical content knowledge' (PCK) introduced by Lee S. Shulman. In the 'Consensus Model' (CM) and the 'Refined Consensus Model' (RCM), PCK was further developed and differentiated. Nevertheless, neither PCK nor CM and RCM…

The Programme for International Student Assessment (PISA) introduced creative thinking as an innovative domain in 2022. This paper examines the unique methodological issues in international assessments and the implications of measuring creative thinking within PISA's framework, including stratified sampling, rotated form designs, and a distinct…

The Program for the International Assessment of Adult Competencies (PIAAC) is a multicycle survey of adult skills and competencies sponsored by the Organization for Economic Cooperation and Development (OECD). The survey examines a range of basic skills in the information age and assesses these adult skills consistently across participating…

A psychological framework for different types of items commonly used with mixed-format exams is proposed. A choice model based on signal detection theory (SDT) is used for multiple-choice (MC) items, whereas an item response theory (IRT) model is used for open-ended (OE) items. The SDT and IRT models are shown to share a common conceptualization…

In this commentary on this issue's focus article by Baird et al., Pellegrino focuses first on the fundamental nature of educational assessment and its connection to theories, models, and data on learning. He then discusses the contemporary views of learning in the form of learning progressions as they relate to assessment development. In the third…

This paper presents a mixture item response tree (IRTree) model for extreme response style. Unlike traditional applications of single IRTree models, a mixture approach provides a way of representing the mixture of respondents following different underlying response processes (between individuals), as well as the uncertainty present at the…

Purpose: This article, based on an invited talk, aims to explore the relationship among large-scale assessments, creativity and personalized learning. Design/Approach/Methods: Starting with the working definition of large-scale assessments, creativity, and personalized learning, this article identified the paradox of combining these three…

The OECD's Programme of International Student Assessment known as PISA, including the Gender Report published in 2015, is a well-received project and its findings keep being transferred into educational policy development. Its quantitative methodology and the sheer volume of data gathered from around 5,100,000 students from 65 countries seem to…

School socio-economic compositional (SEC) effects have been influential in educational research predicting a range of outcomes and influencing public policy. However, some recent studies have challenged the veracity of SEC effects when applying residualised-change and fixed effects models and simulating potential measurement errors in hierarchical…

Employing Connelly and Xu's (this issue) conceptualisation of reciprocal learning, the article explores the potential for reciprocal learning about pedagogy provided by a body of PISA-inspired literature on high-performing education systems. I argue that the opportunities for reciprocal learning provided by that body of literature is rather…

In the face of the dominant World Class University rhetoric and ranking paradigm, most academic leaders and their academic communities have had difficulty conceptualizing and articulating their grander purpose and multiple engagements with society. Some seem to wait for the next ministerial edict to help or push them toward greater societal…

Adopting a comparative perspective to address educational issues in different contexts was a hallmark of Jullien's work in the early-nineteenth century. Different emphases and approaches to comparative education methodology have emerged in recent times thanks to major developments in technology, but have these changes rendered Jullien's ideas…

This article draws on current literature leading to the development of a holistic framework to support practitioners in observation and assessment of childrens evolving inquiry skills. Evidence from the 2011 Trends in International Maths and Science Study (TIMSS) in England identifies a decline of year five student achievement in science. A…

The OECD is planning to enhance existing PISA assessment instruments in reading, mathematics and science so that they will be more suitable to the context of developing countries. The main purpose of this paper is to identify the main technical issues associated with this aim. The paper reports detailed analysis of the existing PISA item pool and…