Arithmetic fluency is regarded as a foundational math skill, typically measured as a single construct with pencil-and-paper-based timed assessments. We introduce a tablet-based assessment of single-digit fluency that captures individual trial response times across several embedded experimental contrasts of interest. A large (n = 824) cohort of…

This study examines the conceptual understanding of numbers and operations among 372 fifth-grade students, based on their responses to an online three-tier test designed to assess their number sense, declarative knowledge, explanatory knowledge, and confidence. The results showed that most students had low performance and low number sense, with…

The purpose of this study is to examine the views of the course teacher, students' and participant researcher's field notes about traditional (smart board, pen and paper, oral) and Web 2.0 supported (A Sample of Kahoot) formative assessment in 5th grade science course. The study employed case study design. The participants of the study were a…

It has been suggested that the reading acceleration program (RAP) (Breznitz et al. in Nature Communications 4: 1486, 2013), in which participants are forced to read at a rate faster than their normal reading fluency rate, improves reading fluency and comprehension in alphabetic languages. However, its effectiveness has never been examined in…

Background: Item response times in computerized assessments are frequently used to identify rapid guessing behaviour as a manifestation of response disengagement. However, non-rapid responses (i.e., with longer response times) are not necessarily engaged, which means that response-time-based procedures could overlook disengaged responses.…

As assessments move towards computerized testing and making continuous testing available the need for rapid assembly of forms is increasing. The objective of this study was to investigate variability in assembled forms through the lens of first- and second-order equity properties of equating, by examining three factors and their interactions. Two…

Purpose: The aim of this study was to advance the analysis of written language transcripts by validating an automated scoring procedure using an automated open-access tool for calculating morphological complexity (MC) from written transcripts. Method: The MC of words in 146 written responses of students in fifth grade was assessed using two…

Star Math (SM) is a popular computer adaptive test (CAT) schools use to screen students for academic risk. Despite its popularity, few independent investigations of its diagnostic accuracy have been conducted. We evaluated the diagnostic accuracy of SM based upon vendor provided cut-scores (25th and 40th percentiles nationally) in predicting…

Currently mathematics difficulties in schools are a major problem due to several factors. Some research suggest that mathematics teaching-learning methodology could be one of the causes. As a result, alternative teaching methods to the traditional approach (ciphers-based closed algorithm [CBC]) have emerged, such as numbers-based open algorithm…

This study collected teacher perspectives on the impact of mandated high-stakes online testing to identify current needs for teachers and students regarding the development of student technology skills for such assessments. Participants included 41 teachers who instruct students in 3rd, 4th, or 5th grade in any capacity from ten school districts…

This study explored the validity of growth on two computer adaptive tests, Star Reading and Star Math, in explaining performance on an end-of-year achievement test for a sample of students in Grades 3 through 6. Results from quantile regression analyses indicate that growth on Star Reading explained a statistically significant amount of variance…

We used multivariate generalizability theory to examine the reliability of hand-scoring and automated essay scoring (AES) and to identify how these scoring methods could be used in conjunction to optimize writing assessment. Students (n = 113) included subsamples of struggling writers and non-struggling writers in Grades 3-5 drawn from a larger…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the online delivery of the 2023 Elementary-Level (Grade 5) and Intermediate-Level (Grade 8) Science Computer-Based Field Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability…

English Language Learners (ELLs) are at an academic disadvantage with the rest of general education because they are linguistically challenged, especially in reading. Educators are recommended to use best practices to provide a good quality education to ELLs through the use of instructional tools. One instructional tool that is recommended to use…

Assessment of language skills for upper elementary and middle schoolers is important due to the strong link between language and reading comprehension. Yet, currently few practical, reliable, valid, and instructionally informative assessments of language exist. This study provides validation evidence for Monster, P.I., which is a gamified,…