In this research, multistage adaptive tests (MST) were compared according to sample size, panel pattern and module length for top-down and bottom-up test assembly methods. Within the scope of the research, data from PISA 2015 were used and simulation studies were conducted according to the parameters estimated from these data. Analysis results for…

When analyzing large-scale assessments (LSAs) that use complex sampling designs, it is important to account for probability sampling using weights. However, the use of these weights in multilevel models has been widely debated, particularly regarding their application at different levels of the model. Yet, no consensus has been reached on the best…

We investigated the potential impact of differential item functioning (DIF) on group-level mean and standard deviation estimates using empirical and simulated data in the context of large-scale assessment. For the empirical investigation, PISA 2018 cognitive domains (Reading, Mathematics, and Science) data were analyzed using Jackknife sampling to…

Background: Standard methods for analysing data from large-scale assessments (LSA) cannot merely be adopted if hierarchical (or multilevel) regression modelling should be applied. Currently various approaches exist; they all follow generally a design-based model of estimation using the pseudo maximum likelihood method and adjusted weights for the…

Descriptive analyses of socially important or theoretically interesting phenomena and trends are a vital component of research in the behavioral, social, economic, and health sciences. Such analyses yield reliable results when using representative individual participant data (IPD) from studies with complex survey designs, including educational…

Research Question: This paper examines the overarching question of to what extent different analytic choices may influence the inference about country-specific cross-sectional and trend estimates in international large-scale assessments. We take data from the assessment of PISA mathematics proficiency from the four rounds from 2003 to 2012 as a…

In this paper, we estimate the causal effect of an extra year of schooling on mathematics performance for seven Latin American countries based on PISA 2012. To that end we exploit exogenous variation in students' birthdates around the school entry cut-off date using both sharp and fuzzy Regression Discontinuity designs. We find strong effects of…

Since 2003, the Programme for International Student Assessment (PISA) has included students with special educational needs (SEN), identified as those with functional disabilities, those with cognitive/behavioural/emotional disabilities and those with limited test language proficiency. While the number of countries and included students has…

New evidence presented in this paper shows that existing accounts of Programme for International Student Assessment (PISA) in developing countries underestimate both progress and inequality because they do not take into account the large proportion of 15-16-year olds who are ineligible for the PISA sampling frame, primarily due to dropout or…

Across many of the middle- and low-income countries that have participated in the Programme for International Student Assessment (PISA) or are potential new participants, significant proportions of 15-year-olds are not enrolled in school or are in school but in grades below PISA's target sample (Grade 7 and above) and thus not eligible to sit for…

This article presents findings on the consequences of matrix sampling of context questionnaires for the generation of plausible values in large-scale assessments. Three studies are conducted. Study 1 uses data from PISA 2012 to examine several different forms of missing data imputation within the chained equations framework: predictive mean…

This paper accepts that the OECD's PISA has become influential in policy terms globally, but analyses the ways that the main PISA and PISA for Schools tests are positioned differently in Australia and the USA because of contrasting educational federalisms in the two nations. Our argument is that while PISA is undoubtedly influential, its effects…

Recent policy suggestions from the European Community underlined the importance of "efficiency" and "equity" in the provision of education while, at the same time, the European countries are required to provide their educational services by minimizing the amount of public money devoted to them. In this article, an empirical…

International large-scale assessments are on the rise, with the Programme for International Student Assessment (PISA) seen by many as having strategic prominence in education policy debates. The present article reviews PISA-related English-language peer-reviewed articles from the programme's first cycle in 2000 to its most current in 2015. Five…

The main purpose of this study is to improve estimation efficiency in obtaining maximum marginal likelihood estimates of contextual effects in the framework of nonlinear multilevel latent variable model by adopting the Metropolis-Hastings Robbins-Monro algorithm (MH-RM). Results indicate that the MH-RM algorithm can produce estimates and standard…