Large scale international assessments depend on invariance of measurement across countries. An important consideration when observing cross-national differential item functioning (DIF) is whether the DIF actually reflects a source of bias, or might instead be a methodological artifact reflecting item response theory (IRT) model misspecification.…

This study capitalizes on response and process data from the computer-based TIMSS 2019 Problem Solving and Inquiry tasks to investigate gender differences in test-taking behaviors and their association with mathematics achievement at the eighth grade. Specifically, a recently proposed hierarchical speed-accuracy-revisits (SAR) model was adapted to…

This study focused on the relationships between teacher characteristics and students' mathematics achievement in EU countries, including Hungary, Italy, Lithuania, Malta, Slovenia, Sweden, and Turkey, which are the only EU countries participated in TIMSS 2015 at the eighth-grade level. The data consisted of the sample of 31,969 eighth-grade…

This study examined the impact of two questionnaire characteristics, scale position and questionnaire length, on the prevalence of random responders in the TIMSS 2015 eighth-grade student questionnaire. While there was no support for an absolute effect of questionnaire length, we did find a positive effect for scale position, with an increase of…

The study aims to investigate how confidence in mathematics/science, amount of books in the home, gender, whether a student likes being in school, and computer software predicted mathematics and science achievements of students in the Trends in International Mathematics and Science Study (TIMSS) 2019. The sample of the study consisted of…

This study investigated how domain specificity of academic motivation related to the connection between instructional clarity and academic achievement in science and mathematics. It focused on three aspects of domain-specific academic motivation--self-concept, intrinsic value, and utility value--drawing from the Expectancy-Value Theory model. The…

We investigated two research questions: which students are more likely to respond inconsistently to mixed-worded questionnaire scales, and which country samples have larger shares of inconsistent respondents? We defined an inconsistent response as strongly agreeing or disagreeing with both positively and negatively worded items of the same scale.…

The Trends in International Mathematics and Science Study (TIMSS) is an international comparison study of mathematics and science performance, organised by the International Association for the Evaluation of Educational Achievement (IEA). The study's main purpose is to provide participating countries with internationally comparable data on the…

Unfavorable test-taking behaviors, such as speededness and disengagement, have long been a validity concern for large-scale low-stakes assessments. Understanding the presence and extent of such behaviors is important for ensuring the validity of inferences based on test scores. This study examined test-taking behaviors using item response time…

Background/purpose: Science education has gained more prominence as a means of educating students for the demands of a technologically evolved world. Understanding the variables influencing students' science achievement is vital for educational policymakers and practitioners. Materials/methods: The study used a hierarchical multiple regression…

Covariational reasoning (or the coordination of two dynamically changing quantities) is central to secondary STEM subjects, but research has yet to fully explore its applicability to elementary and middle-grade levels within various STEM fields. To address this need, we selected a globally referenced STEM assessment--the Trends in International…

In cognitive diagnosis assessment (CDA), the impact of misspecified item-attribute relations (or "Q-matrix") designed by subject-matter experts has been a great challenge to real-world applications. This study examined parameter estimation of the CDA with the expert-designed Q-matrix and two refined Q-matrices for international…

The present study explores the validity of inferences that may be drawn from the Trends in International Mathematics and Science Study (TIMSS) learner achievement data by measuring the South African curriculum-TIMSS alignment for the Grade 8 science assessments from 2007 to 2019. The Singapore curriculum--TIMSS alignment indices are a fair…

This study aims to demonstrate the optimal way to determine the cut-off score to be used to interpret the total scores obtained from an achievement test or scale using the Artificial Neural Networks method. To this end, the multiple-choice item responses in the Booklet-11 Mathematics subtest at the 8th grade level in the TIMSS 2015 Turkey sample…

In this study, in line with TIMSS 2019 data, 8th grade students' school engagement in the Turkish education system and various variables in the field of science and mathematics, which are thought to be related to school engagement, were examined with the Random Forest method, a method amongst data mining methods. This research focuses on student…