Contribution: We present a framework for teachers to investigate the relationships between attributes of students' solutions in the process of problem solving or computational thinking. We provide visualization and evaluation techniques to find hidden patterns in the students' solutions which allow teachers to predict the specific behavior of…

The importance of mathematical problem solving (MPS) has been widely recognized. While there has been significant progress in developing and studying interventions to support teaching and learning MPS for students with disabilities, the research on how to accurately and effectively assess the impact of those interventions has lagged, leaving a gap…

The development of a set of rubrics for teachers and curriculum designers interested in the quality of numeracy tasks emerged from our struggle with an attempt to clarify the distinction between numeracy and mathematics. Shifting our perspective from asking what numeracy and mathematics are to asking what they are about led to the…

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed…

Arithmetic fluency is regarded as a foundational math skill, typically measured as a single construct with pencil-and-paper-based timed assessments. We introduce a tablet-based assessment of single-digit fluency that captures individual trial response times across several embedded experimental contrasts of interest. A large (n = 824) cohort of…

Background: Cultivating students' problem-solving knowledge and skills in the workspace has been regarded as a primary goal in technical and vocational education. To this end, students are usually guided to complete the learning of workspace knowledge and skills by following the question, prompt, interaction and evaluation (QPIE) procedure.…

With the deepening of educational reform, classroom teaching constantly emphasizes the importance of context, and the simulated situational teaching method is gradually applied in the instructional design of activities. As an important part of the education and teaching process, evaluation which is the process of determining the changes in…

This study has three aims: (1) test the effectiveness of using an ebook based on the Collegiate Learning Assessment (CLA) Task to empower critical explanatory ability; (2) examine the influence of problem-solving style differences on critical explanatory ability; and (3) assess the interaction between the use of CLA Task-based Ebooks and…

This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential.…

In massive open online course (MOOC) environments, computer-based analysis of course reviews enables instructors and course designers to develop intervention strategies and improve instruction to support learners' learning. This study aimed to automatically and effectively identify learners' concerned topics within their written reviews. First, we…

Computation competence (CC) in simple addition and subtraction using non-counting (NC) strategies is an important learning objective in Grade 1 mathematics but many children, especially low achievers in mathematics, struggle to acquire these skills. To provide these students with the support they need, it is important to have valid and reliable…

A technology-based problem-solving test can automatically capture all the actions of students when they complete tasks and save them as process data. Response sequences are the external manifestations of the latent intellectual activities of the students, and it contains rich information about students' abilities and different problem-solving…

Social problem solving (SPS) represents a social cognitive reasoning process that gives way to behavior when individuals are navigating challenging social situations. Autistic individuals have been shown to struggle with specific aspects of SPS, which, in turn, has been related to social difficulties in children. However, no previous work has…

The objective of this study is to explore new ways of assessing collaborative problem solving (CPS) processes based on different modalities of audio data and their combination. The data collection took place in an educational lab setting during an experiment with adult teams from professional contexts who collaboratively solved multiple problems…

We present our analysis of 254 Calculus I final exams from U.S. colleges and universities to identify features of assessment items that necessitate qualitatively distinct ways of understanding and reasoning. We explore salient features of exemplary tasks from our data set to reveal distinctions between exam items made apparent by our analytical…