Star Math (SM) is a popular computer adaptive test (CAT) schools use to screen students for academic risk. Despite its popularity, few independent investigations of its diagnostic accuracy have been conducted. We evaluated the diagnostic accuracy of SM based upon vendor provided cut-scores (25th and 40th percentiles nationally) in predicting…

Assessing preservice' higher order thinking skills (HOTS) in science and mathematics is essential. Teachers' HOTS ability is closely related to their ability to create HOTS-type science and mathematics problems. Among various types of HOTS, one is Bloomian HOTS. To facilitate the preservice teacher to create problems in those subjects, an Android…

This study investigates the time-use patterns of students with learning disabilities during digital mathematics assessments and explores the role of extended time accommodations (ETA) in shaping these patterns. Using latent profile analysis, four distinct time-use profiles were identified separately for students with and without ETA. "Initial…

Effective personalization of education requires knowing how each student will perform under certain conditions, given their specific characteristics. Thus, the demand for interpretable and precise estimation of heterogeneous treatment effects is ever-present. This paper outlines a new approach to this problem based on the Leave-One-Out Potential…

Currently mathematics difficulties in schools are a major problem due to several factors. Some research suggest that mathematics teaching-learning methodology could be one of the causes. As a result, alternative teaching methods to the traditional approach (ciphers-based closed algorithm [CBC]) have emerged, such as numbers-based open algorithm…

The National Assessment of Educational Progress (NAEP), often referred to as The Nation's Report Card, offers a window into the state of U.S. K-12 education system. Since 2017, NAEP has transitioned to digital assessments, opening new research opportunities that were previously impossible. Process data tracks students' interactions with the…

Due to low cost monte-carlo (MC) simulations have been extensively conducted in the area of educational measurement. However, the results derived from MC studies may not always be generalizable to operational studies. The purpose of this study was to provide a methodological discussion on the other different types of simulation methods, and run…

Online testing is now becoming more prevalent internationally, across different educational levels. However, little is known about the impact of this mode of testing on male and female students' anxiety levels and test performance. Conducted in an Indonesian sociocultural context which is under-represented in the international literature, this…

This study collected teacher perspectives on the impact of mandated high-stakes online testing to identify current needs for teachers and students regarding the development of student technology skills for such assessments. Participants included 41 teachers who instruct students in 3rd, 4th, or 5th grade in any capacity from ten school districts…

This study investigates the impact of artificial intelligence (AI)-assisted assessment on young L2 learners' vocabulary knowledge, immunity, and resilience, considering parental and teacher support roles. Sixty junior high school students in Afghanistan, aged 13 to 14, participated in the study. They were divided into an experimental group…

This study explored the validity of growth on two computer adaptive tests, Star Reading and Star Math, in explaining performance on an end-of-year achievement test for a sample of students in Grades 3 through 6. Results from quantile regression analyses indicate that growth on Star Reading explained a statistically significant amount of variance…

Implementing a randomized controlled trial design, the present study investigated the effects of two types of accommodations, linguistic modification and a glossary, for English learners (ELs) taking a computer-based mathematics assessment. Process data including response time and clicks on glossary words were also examined to better interpret…

The use of technology in assessment continues to evolve the field of educational measurement. This article reports on development and use of new accessible, technology-enhanced assessments designed to measure the three-dimensional science abilities of middle school students. The assessments were piloted with over 70 teachers and 8,000 students…

Prior research on the Measures of Academic Progress (MAP), a computer-adaptive test distributed by the Northwest Evaluation Association, has primarily focused on the Reading MAP for screening/benchmarking in elementary grades. The purpose of this study was to explore the functional form of growth and the extent to which student variability in…

An automated essay scoring (AES) program is a software system that uses techniques from corpus and computational linguistics and machine learning to grade essays. In this study, we aimed to describe and evaluate particular language features of Coh-Metrix for a novel AES program that would score junior and senior high school students' essays from…