International large-scale assessments (ILSA) are an important source of information for education policymakers across the globe. Despite sponsors' warnings, when results are published, media attention focuses on country rankings and changes in scores. Score changes are evaluated using a two-sided z-statistic, with statistical significance declared…

In this study, we explored psychometric network analysis (PNA) as an alternative method for identifying item wording effects in self-report instruments. We examined the functioning of negatively worded items in the network structures of two math-related scales from the 2019 Trends in International Mathematics and Science Study (TIMSS); Students…

The overall aim of this study was to examine the different self-reported students' socioeconomic status (SES) measures in the Trends in Mathematics and Science Study (TIMSS) in comparison to national SES measures obtained from Swedish official registers. A further aim was to determine if the same conclusions could be drawn if different student…

Measurement invariance analyses are carried out in order to find evidence for the structural validity of the measurement tools used in the field of educational sciences and psychology. The purpose of this research is to examine the measurement invariance of Science Motivation and Self-Efficacy Model constructed by Instrumental Motivation to Learn…

Noncognitive assessments in Programme for International Student Assessment (PISA) and Trends in International Mathematics and Science Study share certain similarities and provide complementary information, yet their comparability is seldom checked and convergence not sought. We made use of student self-report data of Instrumental Motivation,…

Problem Statement: Student achievement is considered an indicator of the quality of education, and achievement tests are applied to assess student achievement. International tests are adapted into different languages and cultures with the aim of assessing student achievement on an international level and comparing the achievements of different…

In large-scale educational surveys, a latent regression model is used to compensate for the shortage of cognitive information. Conventionally, the covariates in the latent regression model are principal components extracted from background data. This operational method has several important disadvantages, such as the handling of missing data and…

Background: Large-scale cross-national studies designed to measure student achievement use different social, cultural, economic and other background variables to explain observed differences in that achievement. Prior to their inclusion into a prediction model, these variables are commonly scaled into latent background indices. To allow…

This study explored motivation and engagement among North American (the United States and Canada; n = 1,540), U.K. (n = 1,558), Australian (n = 2,283), and Chinese (n = 3,753) secondary school students. Motivation and engagement were assessed via students' responses to the Motivation and Engagement Scale-High School (MES-HS). Confirmatory factor…

Cross-national comparisons of responses to survey items are often affected by response style, particularly extreme response style (ERS). ERS varies across cultures, and has the potential to bias inferences in cross-national comparisons. For example, in both PISA and TIMSS assessments, it has been documented that when examined within countries,…

This report provides an overview and discussion of the past decade of academic evidence on the causal effects of resources in schooling on students' outcomes. Early evidence lacked good strategies for estimating the effects of schools resources, leading many people to conclude that spending more on schools had no effect. More recent evidence using…

Discusses results of the National Assessment of Educational Progress (NAEP) and the Third International Mathematics and Science Study (TIMSS), which examined the use of educational technology. Topics include validity and interpretation of results; and what needs to change about how technology is used in education, including adding technology…

Academic achievement and opportunity to learn (OTL) were studied using data from the 1995 Third International Mathematics and Science Study (TIMSS) for Colorado students at the elementary level. The study used a comprehensive definition of OTL that included content coverage, curricular focus, duration of instruction, and instructional strategies.…

The Third International Mathematics and Science Study (TIMSS) contains no direct measures of student ability and motivation. Researchers created a new variable, Student Task Persistence (STP), that is an index of student engagement in providing answers to TIMSS questions on the background questionnaire. The purpose of this research was to…

Describes the development of the performance assessment tasks of the Third International Mathematics and Science Study. The challenge was to produce tasks that would measure the achievement of curricular objectives while being sufficiently reliable to allow comparisons between countries and of groups within countries. (SLD)