Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

The purpose of this study was to evaluate the population invariance of equating functions across country subgroups in TIMSS 2015 mathematics tests in relation to the raw-score distribution, DIF, and DTF. We used equipercentile and IRT observed-score equating methods. The results of the study indicate that there is a relationship between the…

This research proposes a new statistic for testing latent variable distribution fit for unidimensional item response theory (IRT) models. If the typical assumption of normality is violated, then item parameter estimates will be biased, and dependent quantities such as IRT score estimates will be adversely affected. The proposed statistic compares…

One of the main objectives of international large-scale assessments is to make comparisons between different countries, education policies, education systems, or subgroups. One of the main criteria for making comparisons between different groups is to ensure measurement invariance. The purpose of this study was to test the measurement invariance…

Results of the TIMSS 2019 reveal that Kosovar students have lower achievement levels in both mathematics and science. In understanding this gap in achievement, it is of value to take a closer look at factors that may influence student learning. Results of this analysis reveal that factors such as home and school resources influence achievement…

Although International Association for the Evaluation of Educational Achievement-pioneered international large-scale assessment (ILSA) of education is now a well-established science, non-practitioners and many users often substantially misunderstand how large-scale assessments are conducted, what questions and challenges they are designed to…

Data literacy is increasingly important in today's data-driven world. Students across many educational systems first formally learn about data in elementary school not as a separate subject but via the mathematics curriculum. This experience can create tensions in the priorities of learning and assessment given the presence of other foundational…

Previous research on the implications of early-tracking education systems has not specifically focused on how studying in academic and non-academic tracks shapes the features and characteristics of shadow education (private tutoring) that students are involved in. The study compares the scale and features of private tutoring and the underlying…

This study finds that, breaking with decades of slow improvement, U.S. reading and math scores on the National Assessment of Educational Progress (NAEP) and other assessments have seen historic declines since most states implemented national Common Core English and math curriculum standards six years ago. This descriptive analysis is designed to…

Since 1995, the International Association for the Evaluation of Educational Achievement (IEA) implemented the Trends in International Mathematics and Science Study (TIMSS) as an international comparative study. This article aims at identifying the correlations of science classroom instructions with TIMSS science achievement of eighth graders among…

In educational and psychological research, it is common to use latent factors to represent constructs and then to examine covariate effects on these latent factors. Using empirical data, this study applied three approaches to covariate effects on latent factors: the multiple-indicator multiple-cause (MIMIC) approach, multiple group confirmatory…

The 2015 Trends in International Mathematics and Science Study (TIMSS) involved 57 countries and 43 different languages to assess students' achievement in mathematics and science. The purpose of this study is to evaluate whether items and test scores are affected as the differences between language families and cultures increase. Using…

Item response theory (IRT) has so many advantages than its precedent Classical Test Theory (CTT) such as non-changing item parameters, ability parameter estimations free from the items. However, in order to get these advantages, some assumptions should be met and they are; unidimensionality, normality and local independence. However, it is not…

Has the gap in average standardized test scores between students from high- and low-income families widened, narrowed, or remained stable over the last 3 decades? The question is important both because the achievement gap is measure of how (un)equally educational opportunities are distributed in the US, and because the disparity in educational…

We set out to address the question--what does it mean for educational knowledge to be 'powerful'? We compare the Anglo tradition of curriculum studies with the "Didaktik" tradition through the lens of an analysis of curriculum structure in postgraduate courses in South African universities rooted in either the Anglo or…