The use of digital technologies in teaching and learning processes has opened new and wide frontiers in mathematics education. Research in education moves towards teaching and learning (and assessing) twenty-first-century skills and computer-based testing seems an interesting possibility for assessing such skills. From this perspective, comparing…

This study examines the conceptual understanding of numbers and operations among 372 fifth-grade students, based on their responses to an online three-tier test designed to assess their number sense, declarative knowledge, explanatory knowledge, and confidence. The results showed that most students had low performance and low number sense, with…

Written answers to open-ended questions can have a higher long-term effect on learning than multiple-choice questions. However, it is critical that teachers immediately review the answers, and ask to redo those that are incoherent. This can be a difficult task and can be time-consuming for teachers. A possible solution is to automate the detection…

As assessments move towards computerized testing and making continuous testing available the need for rapid assembly of forms is increasing. The objective of this study was to investigate variability in assembled forms through the lens of first- and second-order equity properties of equating, by examining three factors and their interactions. Two…

Star Math (SM) is a popular computer adaptive test (CAT) schools use to screen students for academic risk. Despite its popularity, few independent investigations of its diagnostic accuracy have been conducted. We evaluated the diagnostic accuracy of SM based upon vendor provided cut-scores (25th and 40th percentiles nationally) in predicting…

Currently mathematics difficulties in schools are a major problem due to several factors. Some research suggest that mathematics teaching-learning methodology could be one of the causes. As a result, alternative teaching methods to the traditional approach (ciphers-based closed algorithm [CBC]) have emerged, such as numbers-based open algorithm…

This study explored the validity of growth on two computer adaptive tests, Star Reading and Star Math, in explaining performance on an end-of-year achievement test for a sample of students in Grades 3 through 6. Results from quantile regression analyses indicate that growth on Star Reading explained a statistically significant amount of variance…

Prior research on the Measures of Academic Progress (MAP), a computer-adaptive test distributed by the Northwest Evaluation Association, has primarily focused on the Reading MAP for screening/benchmarking in elementary grades. The purpose of this study was to explore the functional form of growth and the extent to which student variability in…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

Little evidence exists regarding students' actual use of testing time in naturalistic settings, particularly in the context of state accountability assessments. This study investigates students' test completion time and performance in the context of a statewide, English Language Arts and Mathematics computer-based assessment administered in grades…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 Mathematics Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020 Grades 6-8…

The New York State Education Department (NYSED) has a partnership with Questar Assessment Inc. (Questar) for the development of the 2020 Grades 3-8 Mathematics Tests. Teachers from across the State work with NYSED in a variety of activities to ensure the validity and reliability of the New York State Testing Program (NYSTP). The 2020 Grades 3-5…

This paper presents results of a score interpretation study for a computer adaptive mathematics assessment. The study purpose was to test the efficacy of item developers' alignment of items to Range Achievement-Level Descriptors (RALDs; Egan et al.) against the empirical achievement-level alignment of items to investigate the use of RALDs as the…

This research study investigates the impact of the rapid transition from paper-based to online administration of the State of Texas Assessments of Academic Readiness (STAAR) exams on student performance in a South Texas school district. The transition, mandated by House Bill 3261, presented Texas public schools with a tight timeline for adapting…

The current study examined the criterion validity of a computer adaptive universal screener with an end-of-year state mathematics assessment using extant data provided by a local education agency. Participants included 1,195 third through eighth graders. Correlational analyses were used to report predictive and concurrent validity coefficients for…