This study aimed to examine an assumption regarding whether generative artificial intelligence (GAI) tools can overcome the cognitive intensity that humans suffer when solving problems. We examine the performance of ChatGPT and GPT-4 on NAEP science assessments and compare their performance to students by cognitive demands of the items. Fifty-four…

In this article the authors overview how the recently revised (version 9) Australian Curriculum (Australian Curriculum Assessment and Reporting Authority, 2022) and student difficulties with fractions relate to five developmental Fraction Schemes developed from multiple research projects in the literature. The article shares research findings from…

Since the standards-based education movement began in the early 1990s, mathematics education reformers have developed and evaluated many interventions to support students in mastering more rigorous content. We conducted a systematic review and meta-analysis of U.S. PreK-12 mathematics intervention effects from 1991 to 2017 to study sources of…

The purpose of this study is to equate Trends in International Mathematics and Science Study (TIMSS) mathematics subtest scores obtained from TIMSS 2011 to scores obtained from TIMSS 2007 form with different nonlinear observed score equating methods under Non-Equivalent Anchor Test (NEAT) design where common items are used to link two or more test…

Item response theory (IRT) has so many advantages than its precedent Classical Test Theory (CTT) such as non-changing item parameters, ability parameter estimations free from the items. However, in order to get these advantages, some assumptions should be met and they are; unidimensionality, normality and local independence. However, it is not…

In March 2019 the Ministry of Education (MOE) commissioned NZCER to conduct an exploratory study of curriculum levelling in the Science and Mathematics and Statistics learning areas of "The New Zealand Curriculum" (NZC). The study was prompted in part by a desire to probe possible reasons for patterns of achievement reported by the…

This paper describes the content, organization and rigor of the f2f and online summer algebra courses that were delivered in summers 2011 and 2012. Examining the content of both types of courses is important because research suggests that algebra courses with certain features may be better than others in promoting success for struggling students.…

South Africa participated in TIMSS from 1995 to 2015. Over these two decades, some positive changes have been reported on the aggregated mathematics performance patterns of South African learners. This paper focuses on the achievement patterns of South Africa's high-performing Grade 9 learners (n = 3378) in comparison with similar subsamples of…

Energy is a core concept in the teaching of science. Therefore, it is important to know how students' thinking about energy develops so that elementary, middle, and high school students can be appropriately supported in their understanding of energy. This study tests the validity of a proposed theoretical model of students' growth of understanding…

The quality of instruction in the classroom is the most powerful leverage point for school improvement because it is the only thing over which educators have a significant degree of control. As student assessments change to reflect the higher expectations of Common Core State Standards (CCSS), it is important that the assessment and development of…

There are at least two procedures to assess item difficulty stability in the Rasch model: robust z procedure and "0.3 Logit Difference" procedure. The robust z procedure is a variation of the z statistic that reduces dependency on outliers. The "0.3 Logit Difference" procedure is based on experiences in Rasch linking for tests…

Scholars have argued that imprecise data graphics, specifically those displaying decorative dimensionality of data, may lead to inaccurate interpretations. Empirical tests of decorative dimensionality have produced mixed results. The literature also suggests that the effects of decorative dimensionality may depend on the cognitive demand of a…

Embedding support devices in educational computer games has been asserted to positively affect learning outcomes. However, there is only limited direct empirical evidence on which design variations of support provision influence learning. In order to better understand the impact of support design on novices' learning, the current study…

The population sensitivity of vertical scaling results was evaluated for a state reading assessment spanning grades 3-10 and a state mathematics test spanning grades 3-8. Subpopulations considered included males and females. The 3-parameter logistic model was used to calibrate math and reading items and a common item design was used to construct…

The need to address social and economic changes has focused greater attention on our public education system and the need to better equip students with the skills needed for a global society. This quantitative study was grounded in the principles of the constructivist learning theory. The purpose of this study was to determine whether the added…