Arithmetic fluency is regarded as a foundational math skill, typically measured as a single construct with pencil-and-paper-based timed assessments. We introduce a tablet-based assessment of single-digit fluency that captures individual trial response times across several embedded experimental contrasts of interest. A large (n = 824) cohort of…

The use of digital technologies in teaching and learning processes has opened new and wide frontiers in mathematics education. Research in education moves towards teaching and learning (and assessing) twenty-first-century skills and computer-based testing seems an interesting possibility for assessing such skills. From this perspective, comparing…

Knowledge tracing (KT) is a method to evaluate a student's knowledge state (KS) based on their historical problem-solving records by predicting the next answer's binary correctness. Although widely applied to closed-ended questions, it lacks a detailed option tracing (OT) method for assessing multiple-choice questions (MCQs). This paper introduces…

The ability to solve complex problems successfully represents a key competence for students' educational success and beyond. While strategy application and metastrategic knowledge constitute two underlying components that drive successful complex problem solving (CPS), little is known about how these two facets develop individually and jointly in…

In 2017, the mathematics assessments that are part of the National Assessment of Educational Progress (NAEP) program underwent a transformation shifting the administration from paper-and-pencil formats to digitally-based assessments (DBA). This shift introduced new interactive item types that bring rich process data and tremendous opportunities to…

Online educational games have been widely used to support students' mathematics learning. However, their effects largely depend on student-related factors, the most prominent being their behavioral characteristics as they play the games. In this study, we applied a set of learning analytics methods (k-means clustering, data visualization) to…

Online educational games have been widely used to support students' mathematics learning. However, their effects largely depend on student-related factors, the most prominent being their behavioral characteristics as they play the games. In this study, we applied a set of learning analytics methods ("k"-means clustering, data…

This study explores the use of the Adaptive Neuro-Fuzzy Inference System (ANFIS), a neuro-fuzzy approach, to analyze the log data of technology-based assessments to extract relevant features of student problem-solving processes, and develop and refine a set of fuzzy logic rules that could be used to interpret student performance. The log data that…

Collaborative problem solving (CPS) is an important 21st-century skill for academic and career success, and as a result, there is increased interest among businesses and educational institutions in the assessment and development of CPS skills. CPS skills are difficult to measure using traditional forms of assessment, and that difficulty has led to…

In 1984 Benjamin Bloom stated that one-to-one tutorial support increased students' achievement by two standard deviations (two sigma problem). In the literature for solving two sigma problem (in order to increase student achievement), many systems were developed as intelligent tutoring systems, adaptive hypermedia systems, recommender systems and…

Collaborative problem solving (CPS) is an important 21st-century skill for academic and career success, and as a result, there is increased interest among businesses and educational institutions in the assessment and development of CPS skills. CPS skills are difficult to measure using traditional forms of assessment, and that difficulty has led to…

The current study explores students' collaboration and problem solving (CPS) abilities using a human-to-agent (H-A) computer-based collaborative problem solving assessment. Five CPS assessment units with 76 conversation-based items were constructed using the PISA 2015 CPS framework. In the experiment, 53,855 ninth and tenth graders in Taiwan were…

Mastery behaviours -- seeking out challenging tasks and continuing to work on them despite difficulties -- are integral to achievement but difficult to measure with precision. The current study reports on the development and validation of the computer-based persistence, effort, resilience, and challenge-seeking (PERC) task in two demographically…

This study is part of a larger design study that iteratively improves a robotics programming curriculum as well as a computational thinking (CT) instrument. Its focus was majorly on CT assessment and particularly on an online CT instrument with logging functionality that can store a student's problem-solving process by recording interactions…

A web-based two-tier test (WTTT-NS) which combined the advantages of traditional written tests and interviews in assessing number sense was developed and applied to assess students' answers and reasons for the questions. In addition, students' major misconceptions can be detected. A total of 1,248 sixth graders in Taiwan were selected to…