Random Equating (RE) and Heuristic Approach (HA) are two linking procedures that may be used to compare the scores of individuals in two tests that measure the same latent trait, in conditions where there are no common items or individuals. In this study, RE--that may only be used when the individuals taking the two tests come from the same…

This study investigated the effectiveness of four Digitalized Interactive Components (DICs) designed based on cognitive principles to accommodate individual differences among students with learning difficulties in geometry during computer-based assessments. The four DICs were annotations (allowing students to make notes on the screen), pop-up…

Testing programs have explored the use of technology-enhanced items alongside traditional item types (e.g., multiple-choice and constructed-response items) as measurement evidence of latent constructs modeled with item response theory (IRT). In this report, we discuss considerations in applying IRT models to a particular type of adaptive testlet…

Purpose: This uses quantitative and qualitative methods in assessing performance and process outcomes in a team lecture hybrid (TLH) instructional design applied in a public affairs course. Design/methodology/approach: Within a non-experimental prospective design, individual and team outcomes were assessed as follows: survey of student perceptions…

Successful computer-based assessments for learning greatly rely on an effective learner modeling approach to analyze learner data and evaluate learner behaviors. In addition to explicit learning performance (i.e., product data), the process data logged by computer-based assessments provide a treasure trove of information about how learners solve…

This study aimed to examine the effect of four types of assessment on overall student success in an online college-level climate change course. Quizzes, midterms, lab assignments, and a capstone project as well as knowledge check questions were used to assess different aspects of student learning, consistent with Bloom's taxonomy hierarchy.…

Recent developments in the field of artificial intelligence allow for improved performance in the automated assessment of extended response items in mathematics, potentially allowing for the scoring of these items cheaply and at scale. This study details the grand prize-winning approach to developing large language models (LLMs) to automatically…

The use of digital technologies in teaching and learning processes has opened new and wide frontiers in mathematics education. Research in education moves towards teaching and learning (and assessing) twenty-first-century skills and computer-based testing seems an interesting possibility for assessing such skills. From this perspective, comparing…

Arithmetic fluency is regarded as a foundational math skill, typically measured as a single construct with pencil-and-paper-based timed assessments. We introduce a tablet-based assessment of single-digit fluency that captures individual trial response times across several embedded experimental contrasts of interest. A large (n = 824) cohort of…

In the human-to-human Collaborative Problem Solving (CPS) test, students' problem-solving process reflects the interdependency among partners. The high interdependency in CPS makes it very sensitive to group composition. For example, the group outcome might be driven by a highly competent group member, so it does not reflect all the individual…

Studies have indicated that pictures in test items can impact item-solving performance, information processing (e.g., time on task) and metacognition as well as test-taking affect and motivation. The present review aims to better organize the existing and somewhat scattered research on multimedia effects in testing and problem solving while…

In this paper, we explore the role that examples play as mathematicians formulate conjectures, and we describe and exemplify one particular example-related activity that we observed in interviews with thirteen mathematicians. During our interviews, mathematicians productively used examples as they formulated conjectures, particularly by creating…

This paper presents research activity on computer-based mathematics learning to study the effectiveness of open-source teaching computer platforms (Canvas) in computer-assisted instruction. We designed a set of multiple-choice online quizzes as a dynamical flow-chart of possible paths to follow while solving a difficult math problem on…

This study investigated the impact of computer-aided assessment on the enhancement of critical thinking skills in non-routine problem-solving across three distinct learning delivery modalities: fully online, balanced blended, and predominantly face-to-face (F2F) blended. The study aimed to evaluate the effectiveness of computer-aided assessment in…

The impact of retrieval practice on analogical-problem-solving performance was investigated using a complex, educationally relevant task. Participants studied a statistical hypothesis testing scenario and practiced recalling the material or repeatedly studied it. Participants then completed a final test either 5 minutes or 1 week later involving a…