Large scale international assessments depend on invariance of measurement across countries. An important consideration when observing cross-national differential item functioning (DIF) is whether the DIF actually reflects a source of bias, or might instead be a methodological artifact reflecting item response theory (IRT) model misspecification.…

Modern international studies of educational achievement have grown in terms of participating educational systems. Accompanying this development is an increase in heterogeneity, as more and different kinds of educational systems take part. This growth has been particularly pronounced among low-performing, less economically developed systems.…

This study examined the existence of latent classes in TIMSS 2015 data from three countries, Singapure, Turkey and South Africa, were analyzed using Mixture Item Response Theory (MixIRT) models (Rasch, 1PL, 2PL and 3PL) on 18 multiple-choice items in the science subtest. Based on the findings, it was concluded that the data obtained from TIMSS…

Non-cognitive factors are considered critical aspects in shaping students' academic achievement. This study aims to analyze and explore the mechanisms of the influence of noncognitive factors on 15-year-old students' abilities in China and the United States. Based on the Programme for International Student Assessment (PISA) 2018 education dataset,…

This study aims to reveal (1) the construct and (2) the characteristics of the developed instrument for assessing Physics cognitive learning achievement of high school students in outdoor learning models through local wisdom-based fieldwork. This research was a research and development using the approach developed by Mardapi (2012: 110). The steps…

The purpose of this study was to examine eighth-grade students' science performance in terms of two test design components, item format, and cognitive domain. The portion of Taiwanese data came from the 2011 administration of the Trends in International Mathematics and Science Study (TIMSS), one of the major international large-scale assessments…

This work analyses students' failure in the 2019 Nationwide Chemistry Examination in Greece, which concerns secondary education graduates, competing for admission to higher education Greek institutions. The distinction of thinking skills into higher and lower order (HOTS and LOTS) is used as a theoretical tool for this analysis. The examination…

This study focuses on the teachers' predictions of the students' performances -- in particular the middle-low achievers -- while solving tasks testing inquiry competencies. The tasks come from PISA science. More specifically we study science teachers' predictions for several aspects: levels of difficulty of the tasks, the potential sources of…

The understanding of what makes a question difficult is a crucial concern in assessment. To study the difficulty of test questions, we focus on the case of PISA, which assesses to what degree 15-year-old students have acquired knowledge and skills essential for full participation in society. Our research question is to identify PISA science item…

Item response theory (IRT) has so many advantages than its precedent Classical Test Theory (CTT) such as non-changing item parameters, ability parameter estimations free from the items. However, in order to get these advantages, some assumptions should be met and they are; unidimensionality, normality and local independence. However, it is not…

This study offers curriculum developers, teachers, and science education researchers a fine-grained profile on strengths and weaknesses in specific science domains and topics. The study involved a representative sample of 3844 Norwegian pupils in grade 8. Their responses on 216 TIMSS items in 18 topics from 4 science domains were modelled in a…

The aim of this research was to assess the classification of science test items of TIMSS grade 8 based on higher order thinking skills (HOTS) and determine whether those classified-science test items can be an assessment tool in science class. Sixteen sample test items of HOTS were chosen from 37 reasoning items of TIMSS 1999, 2003, and 2011;…

This article addresses the issue of language-related construct-irrelevant variance on content area tests from the perspective of systemic functional linguistics. We propose that the construct relevance of language used in content area assessments, and consequent claims of construct-irrelevant variance and bias, should be determined according to…

Since 1999 South African learners have participated in various international studies but sadly the learners have continued to perform dismally, which brings to question the quality of their education. Meanwhile, Singaporean students have been among the top achievers in all these competitions. Many comparative studies have been done between…

Background: This paper discusses a framework for analyzing the dependence on mathematical theory in test items, that is, a framework for discussing to what extent knowledge of mathematical theory is helpful for the student in solving the item. The framework can be applied to any test in which some knowledge of mathematical theory may be useful,…