In this study, we explored psychometric network analysis (PNA) as an alternative method for identifying item wording effects in self-report instruments. We examined the functioning of negatively worded items in the network structures of two math-related scales from the 2019 Trends in International Mathematics and Science Study (TIMSS); Students…

Science academic achievement is a key construct for examining students' science learning outcomes. While international comparative assessments like TIMSS and PISA have shown high science achievement of Korean middle school students, there is a lack of comprehensive investigation of factors influencing the achievement using domestic data.…

In this research, structural equation modeling and TIMSS data were employed to examine the impact of school belonging on math achievement among secondary students in Japan, Korea, and the United States, with a focus on the roles of math attitude and disorderly behavior. Utilizing SmartPLS 4.0, the study delved into the reliability and validity of…

The study aims to analyze student responses to chemistry constructed response items to obtain detailed information on science NAEA (National Assessment of Educational Achievement) in South Korea and to draw suggestions for enhancing curriculum, teaching, and learning. For this purpose, we analyzed 7444 answers that could be generalized as 1.29% of…

Here, we describe the development and validation of an automatic assessment system that examines students' hand-drawn visual representations in free-response items. The data were collected from 1,028 students in the second through 11th grades in South Korea using two items from the Test About Particles in a Gas questionnaire (Novick &…

There has been increasing interest in exploring heterogeneous treatment effects using machine learning (ML) methods such as causal forests, Bayesian additive regression trees, and targeted maximum likelihood estimation. However, there is little work on applying these methods to estimate treatment effects in latent classes defined by…

Canonical coherence occurs when subject matter in school is organized to align with the logical structures of an academic discipline. Even though it is highly desired, this condition is an assumption that must be empirically tested, which was the rationale behind our examination of the coherence of topics from middle-school (grades 7-9) integrated…

This brief examines Trends in International Mathematics and Science Study (TIMSS) science achievement of the 20% highest and the 20% lowest performing fourth and eighth graders in 11 countries. To do so, the authors compare achievement distributions across countries, using measures of relative equality within countries. Such an examination…

Modelling ability is one of the essential elements of the latest educational reforms, and Trends in International Mathematics and Science Study (TIMSS) is a curriculum-based assessment which allows educational systems worldwide to inspect the curricular influences. The aims of this study were to examine the role of modelling ability in the…

This article examines the conceivable rationales as to why Korean students' English-speaking proficiency scores are not as outstanding as other international standardized test scores such as the Trends in International Mathematics and Science Study (TIMSS) and the Program for International Student Assessment (PISA). Despite the efforts of the…

Asian culture has been test-centric for over 1,400 years. U.S. education has been since the 1990s. Based on Kim's creative Climates, Attitudes, and Thinking skills (CATs), creativity indicators were developed using the 2015 PISA questionnaires. Study I examined: (1) relationships between students' PISA science scores and CATs; (2) differences…

Since 1995, the International Association for the Evaluation of Educational Achievement (IEA) implemented the Trends in International Mathematics and Science Study (TIMSS) as an international comparative study. This article aims at identifying the correlations of science classroom instructions with TIMSS science achievement of eighth graders among…

Results from the Trends in International Mathematics and Science Study (TIMSS) assessments have shown that students in Korea displayed high levels of science achievement. In order to understand those achievement outcomes, a number of studies have examined science teaching in Korea and explored the effects of teaching practices on student…

Rapid response behaviour, a type of test disengagement, cannot be interpreted as a true indicator of the targeted constructs and may compromise score accuracy as well as score validity for interpretation. Rapid responding may be due to multiple factors for diverse populations. In this study, using Programme for International Student Assessment…

Comparing group is one of the key uses of large-scale assessment results, which are used to gain insights to inform policy and practice and to examine the comparability of scores and score meaning. Such comparisons typically focus on examinees' final answers and responses to test questions, ignoring response process differences groups may engage…