The use of large-scale assessments (LSAs) in education has grown in the past decade though analysis of LSAs using multilevel models (MLMs) using R has been limited. A reason for its limited use may be due to the complexity of incorporating both plausible values and weighted analyses in the multilevel analyses of LSA data. We provide additional…

This paper aims to showcase the value of implementing a Bayesian framework to analyze and report results from international large-scale assessments and provide guidance to users who want to analyse ILSA data using this approach. The motivation for this paper stems from the recognition that Bayesian statistical inference is fast becoming a popular…

The purpose of this paper is to extend and evaluate methods of "Bayesian historical borrowing" applied to longitudinal data with a focus on parameter recovery and predictive performance. Bayesian historical borrowing allows researchers to utilize information from previous data sources and to adjust the extent of borrowing based on the…

When analyzing large-scale assessments (LSAs) that use complex sampling designs, it is important to account for probability sampling using weights. However, the use of these weights in multilevel models has been widely debated, particularly regarding their application at different levels of the model. Yet, no consensus has been reached on the best…

The study of variables related to the use of ICT in the classroom is a topic of interest that has been frequently researched. In this paper, after examining the importance of teacher training in explaining the use of ICT in the classroom, we focused on analysing the weight of variables related to teaching practices and the organisational context…

Background: Science skills play a crucial role in fostering economic development and technological innovation, making the enhancement of science education a global priority. Despite the recognized importance of teacher practices in enhancing equitable and effective learning, much of the research on their impact on student outcomes has been…

Background: Reading and reading comprehension are crucial skills, yet many students in grade 4 struggle with them. To address this, several instructional practices have gained popularity. For one, explicit reading strategy instruction (ERSI) is deemed useful, given the finding that successful readers tend to employ reading strategies. As a second…

Background: Tolerance is a prerequisite for deliberative democracies. Therefore, fostering tolerance is an important task for educational systems in democracies. In the present study, the concepts of social and political tolerance were disentangled and applied to the measurement approaches of the International Civic and Citizenship Education Study…

Tolerance is a prerequisite for deliberative democracies. Therefore, fostering tolerance is an important task for educational systems in democracies. In the present study, the concepts of social and political tolerance were disentangled and applied to the measurement approaches of the International Civic and Citizenship Education Study 2016 (ICCS…

Research Question: This paper examines the overarching question of to what extent different analytic choices may influence the inference about country-specific cross-sectional and trend estimates in international large-scale assessments. We take data from the assessment of PISA mathematics proficiency from the four rounds from 2003 to 2012 as a…

In educational and psychological research, it is common to use latent factors to represent constructs and then to examine covariate effects on these latent factors. Using empirical data, this study applied three approaches to covariate effects on latent factors: the multiple-indicator multiple-cause (MIMIC) approach, multiple group confirmatory…

Low examinee effort is a major threat to valid uses of many test scores. Fortunately, several methods have been developed to detect noneffortful item responses, most of which use response times. To accurately identify noneffortful responses, one must set response time thresholds separating those responses from effortful ones. While other studies…

Background: Evidence so far shows that Waldorf students are characterized by average science achievement but at the same time high socioeconomic status and high science motivation. Moreover, Waldorf education is characterized by high emphasis on inquiry-based science education (IBSE). The present study investigates if the specific…

Background: This paper extends a recent study by Kaplan and Su ("J Educ Behav Stat" 41: 51-80, 2016) examining the problem of matrix sampling of context questionnaire scales with respect to the generation of plausible values of cognitive outcomes in large-scale assessments. Methods: Following Weirich et al. ("Nested multiple…

Background: In low-stakes educational assessments, test takers might show a performance decline (PD) on end-of-test items. PD is a concern in educational assessments, especially when groups of students are to be compared on the proficiency variable because item responses gathered in the groups could be differently affected by PD. In order to…