To provide practice and assessment of computational thinking, we need specific problems students can solve. There are many such problems, but they are hard to find. Learning environments and assessments often use only specific types of problems and thus do not cover computational thinking in its whole scope. We provide an extensive catalog of…

Contribution: We present a framework for teachers to investigate the relationships between attributes of students' solutions in the process of problem solving or computational thinking. We provide visualization and evaluation techniques to find hidden patterns in the students' solutions which allow teachers to predict the specific behavior of…

The importance of mathematical problem solving (MPS) has been widely recognized. While there has been significant progress in developing and studying interventions to support teaching and learning MPS for students with disabilities, the research on how to accurately and effectively assess the impact of those interventions has lagged, leaving a gap…

The development of a set of rubrics for teachers and curriculum designers interested in the quality of numeracy tasks emerged from our struggle with an attempt to clarify the distinction between numeracy and mathematics. Shifting our perspective from asking what numeracy and mathematics are to asking what they are about led to the…

Determining the most appropriate method of scoring an assessment is based on multiple factors, including the intended use of results, the assessment's purpose, and time constraints. Both the dichotomous and partial credit models have their advantages, yet direct comparisons of assessment outcomes from each method are not typical with constructed…

We explore the various Mathematica functions for performing Gaussian elimination, specifically when the linear system contains input parameters. On the one hand, we want the solution, perhaps heuristically found, to be in terms of the input parameters, and as general as possible. On the other hand, we must adhere to all necessary conditions and…

Arithmetic fluency is regarded as a foundational math skill, typically measured as a single construct with pencil-and-paper-based timed assessments. We introduce a tablet-based assessment of single-digit fluency that captures individual trial response times across several embedded experimental contrasts of interest. A large (n = 824) cohort of…

Purpose -- This article comprehensively examines the existing body of literature about the assessment tools employed for evaluating higher-order thinking skills (HOTS) in mathematics within the last five years. The study endeavors to offer a comprehensive overview of measuring instruments for HOTS in mathematics, utilizing precise and up-to-date…

Background: Cultivating students' problem-solving knowledge and skills in the workspace has been regarded as a primary goal in technical and vocational education. To this end, students are usually guided to complete the learning of workspace knowledge and skills by following the question, prompt, interaction and evaluation (QPIE) procedure.…

With the deepening of educational reform, classroom teaching constantly emphasizes the importance of context, and the simulated situational teaching method is gradually applied in the instructional design of activities. As an important part of the education and teaching process, evaluation which is the process of determining the changes in…

This study has three aims: (1) test the effectiveness of using an ebook based on the Collegiate Learning Assessment (CLA) Task to empower critical explanatory ability; (2) examine the influence of problem-solving style differences on critical explanatory ability; and (3) assess the interaction between the use of CLA Task-based Ebooks and…

In this edition of Assessment News, Charles Darr uses a case study from the National Monitoring Study of Student Achievement (NMSSA) to highlight how students can benefit from activating deliberate thinking in assessments. The key message underscores the value of using assessment information to generate insights that inform better teaching and…

The Campbellian validity typology has been used as a foundation for outcome evaluation and for developing evidence-based interventions for decades. As such, randomized control trials were preferred for outcome evaluation. However, some evaluators disagree with the validity typology's argument that randomized controlled trials as the best design…

This research aimed to develop and validate a rubric to assess Artificial Intelligence (AI) chatbots' effectiveness in accomplishing tasks, particularly within educational contexts. Given the rapidly growing integration of AI in various sectors, including education, a systematic and robust tool for evaluating AI chatbot performance is essential.…

In massive open online course (MOOC) environments, computer-based analysis of course reviews enables instructors and course designers to develop intervention strategies and improve instruction to support learners' learning. This study aimed to automatically and effectively identify learners' concerned topics within their written reviews. First, we…