The Programme for International Student Assessment (PISA) introduced creative thinking as an innovative domain in 2022. This paper examines the unique methodological issues in international assessments and the implications of measuring creative thinking within PISA's framework, including stratified sampling, rotated form designs, and a distinct…

The present paper investigates and examines the conditional dependencies between cognitive responses (RA; Response Accuracy) and process data, in particular, response times (RT) in large-scale educational assessments. Using two prominent large-scale assessments, NAEP and PISA, we examined the RA-RT conditional dependencies within each item in the…

Multiple group modeling is one of the methods to address the measurement noninvariance issue. Traditional studies on multiple group modeling have mainly focused on item responses. In computer-based assessments, joint modeling of response times and action counts with item responses helps estimate the latent speed and action levels in addition to…

In large-scale educational assessments, it is generally required that tests are composed of items that function invariantly across the groups to be compared. Despite efforts to ensure invariance in the item construction phase, for a range of reasons (including the security of items) it is often necessary to account for differential item…

Data analysis is a significant methodological component when conducting quantitative education studies. Guidelines for conducting data analyses in quantitative education studies are common but often underemphasize four important methodological components impacting the validity of inferences: quality of constructed measures, proper handling of…

Purpose: This article, based on an invited talk, aims to explore the relationship among large-scale assessments, creativity and personalized learning. Design/Approach/Methods: Starting with the working definition of large-scale assessments, creativity, and personalized learning, this article identified the paradox of combining these three…

Recognizing the limitations of the existing frameworks and models applied to estimate the learning loss caused by COVID-19 across the world by different studies, and the urgent need for estimating such loss at the different education levels, this paper, employs the Education Value Chain Analysis ( EVCA) approach as a new paradigm, attempts to…

In this study, the aim was to construct a significant structural measurement model comparing students' affective characteristics with their mathematic achievement. According to this model, the aim was to test the measurement invariances between gender sub-groups hierarchically. This study was conducted as basic and descriptive research. Secondary…

In this study, it was aimed to model the school characteristics in multivariate structure, and according to this model, aimed to test the invariance of this model across five randomly selected countries and economies from PISA 2012 sample. It is thought that significant differences across group in the context of school characteristics have the…

Complex Problem Solving (CPS) is seen as a cross-curricular 21st century skill that has attracted interest in large-scale-assessments. In the Programme for International Student Assessment (PISA) 2012, CPS was assessed all over the world to gain information on students' skills to acquire and apply knowledge while dealing with nontransparent…

The German education system does not traditionally rely on standardized testing. However, when the Programme for International Student Assessment (PISA) study revealed an average performance of German students compared to other participating countries, a particular proportion of low-performing students, and remarkable disparities between the…

A general diagnostic model was used to specify and compare two multidimensional item-response-theory (MIRT) models for longitudinal data: (a) a model that handles repeated measurements as multiple, correlated variables over time (Andersen, 1985) and (b) a model that assumes one common variable over time and additional orthogonal variables that…