When analyzing large-scale assessments (LSAs) that use complex sampling designs, it is important to account for probability sampling using weights. However, the use of these weights in multilevel models has been widely debated, particularly regarding their application at different levels of the model. Yet, no consensus has been reached on the best…

Hierarchical linear modeling (HLM) is often used to estimate the effects of socioeconomic status (SES) on academic achievement at different levels of an educational system. However, if a prior academic achievement measure is missing in a HLM model, biased estimates may occur on the effects of student SES and school SES. Phantom effects describe…

This paper examines whether parental engagement in early childhood and preschooling act as substitutes, or whether their joint effect enhances students' learning outcomes. We utilize the TIMSS 2019 dataset and employ a hierarchical linear modeling (HLM) approach to analyze data from 52 countries, ensuring a robust examination of cross-national…

This article presents a latent class model for multilevel data to identify latent subgroups and estimate heterogeneous treatment effects. Unlike sequential approaches that partition data first and then estimate average treatment effects (ATEs) within classes, we employ a Bayesian procedure to jointly estimate mixing probability, selection, and…

This study examined the factors that determined the science achievement of fourth-grade students on the Trends in International Mathematics and Science Study (TIMSS) 2019 in the USA. The data were retrieved from the TIMSS international database and imported to the R program for manipulation. The EdSurvey package was used to conduct multilevel…

Effect size reporting is crucial for interpretation of applied research results and for conducting meta-analysis. However, clear guidelines for reporting effect size in multilevel models have not been provided. This report suggests and demonstrates appropriate effect size measures including the ICC for random effects and standardized regression…

In his State of the Nation address on 7 February 2019, the president of the Republic of South Africa. Mr. Cyril Ramaphosa, stated that the government would provide digital workbooks and textbooks to every school child in South Africa by 2025. (De Villiers, 2019). This announcement begs the question how effective the incorporation of Information…

The overall aim of this study is to investigate the effect of school-related factors and early learning experiences on mathematics achievement. In this causal-comparative research, HLM analysis was performed on the data of 6378 students, their parents, and 241 school principals and primary school teachers. As a result of the HLM analysis, at the…

Taiwanese students are featured as having high academic achievement but low motivational beliefs according to the serial results of the Trends in Mathematics and Science Study (TIMSS). Moreover, given that the role of context has become more important in the development of academic motivation theory, this study aimed to examine the relationship…

In this study, it is aimed to examine the effect of classroom assessment on science and mathematics achievements. For this purpose, hierarchical linear modeling (HLM) is performed using variables of like learning science/maths, engage teaching in science/maths, confidence in science/maths, and home resources for learning variables at the student…

The selection of an appropriate booklet design is an important element of large-scale assessments of student achievement. Two design properties that are typically optimized are the "balance" with respect to the positions the items are presented and with respect to the mutual occurrence of pairs of items in the same booklet. The purpose…

This research empirically evaluates data sets from the National Center for Education Statistics (NCES) for design effects of ignoring the sampling design in weighted two-level analyses. Currently, researchers may ignore the sampling design beyond the levels that they model which might result in incorrect inferences regarding hypotheses due to…

Educational effectiveness research has witnessed some growth in the last three decades because the current era of global competitiveness compels each country to train and equip its citizens with knowledge and skills that would make them successful. Researchers from different countries are investigating factors across various levels within the…

Motivational constructs and students' engagements have great impacts on students' mathematics achievements, yet they have not been theoretically investigated using international large-scale assessment data. This study utilized the mathematics data of the Trends in International Mathematics and Science Study 2011 to conduct a comparative and…

This study investigated the performance of U.S. eighth-grade female and minority students' achievement in learning statistics concepts using the Data and Chance content domain from the Trends in International Mathematics and Science Study 2007 (TIMSS 2007). Using variables that have been linked to mathematics and statistics achievement in the…