High-quality science assessments are multi-dimensional. They promote disciplinary practices, core ideas, cross-cutting concepts, and science sense-making. In this paper, we investigate the feasibility of using generative artificial intelligence (GenAI), specifically multimodal large language models (MLLMs), to annotate and provide improvement…

The rapid evolution of generative artificial intelligence (GenAI) is transforming science education by facilitating innovative pedagogical paradigms while raising substantial concerns about scholarly integrity. One particularly pressing issue is the growing risk of student use of GenAI tools to outsource assessment tasks, potentially compromising…

Automated scoring of free drawings or images as responses has yet to be used in large-scale assessments of student achievement. In this study, we propose artificial neural networks to classify these types of graphical responses from a TIMSS 2019 item. We are comparing classification accuracy of convolutional and feed-forward approaches. Our…

The aim of the study is to compare TIMSS 2011 proficiency levels with the proficiency levels defined by the researchers using cluster analysis for Turkey, Korean, Norway, and Morocco in 4th and 8 th grades in the fields of science and mathematics. Therefore, it is tried to be reached that these cut-off scores for each country can serve the…

TIMSS (Trends in International Mathematics and Science Study) is a long-standing international assessment of mathematics and science at the fourth and eighth grades that has been collecting trend data every four years since 1995. About 70 countries use TIMSS trend data for monitoring the effectiveness of their education systems in a global…

This research empirically evaluates data sets from the National Center for Education Statistics (NCES) for design effects of ignoring the sampling design in weighted two-level analyses. Currently, researchers may ignore the sampling design beyond the levels that they model which might result in incorrect inferences regarding hypotheses due to…

Because of a shortage of physical exercise, concerns about adolescents have recently been raised in Taiwan. In educational environments where student exercise has been limited by scheduling constraints and the lack of physical exercise has become a vital problem, "learning while exercising" may be part of a possible solution. This study…

Impact on student achievement of randomly assigned students working individually or collaboratively in mixed- and matched-gender pairs at a computer on predetermined science tasks was investigated. Collaborative dyads shared a computer and screen as each operated an independent keyboard and mouse. A mixed gender control group working individually…

High school students can access original scientific research articles on the Internet, but may have trouble understanding them. To address this problem of online literacy, the authors developed a computer-based prototype for guiding students' comprehension of scientific articles. High school students were asked to read an original scientific…