Knowledge tracing (KT) is a method to evaluate a student's knowledge state (KS) based on their historical problem-solving records by predicting the next answer's binary correctness. Although widely applied to closed-ended questions, it lacks a detailed option tracing (OT) method for assessing multiple-choice questions (MCQs). This paper introduces…

Introduction: This article aimed at digging deep into distractors used for mathematics multiple-choice items. The quality of distractors may be more important than their number and the stem in a multiple-choice question. Little attention is given to this aspect of item writing especially, mathematics multiple-choice questions. This article…

In the context of higher education, a competence may be understood as the combination of skills, knowledge, attitudes, values, and abilities that underpin effective and/or superior performance in a professional area. The aim of the work reported here was to design a set of procedures to assess a transferable competence, i.e., problem solving, that…

This study aimed to examine students' work in online assessments to gain more understanding for designing continuous assessments in a blended learning environment for prospective primary school teachers. The study took place during emergency remote teaching due to the COVID-19 pandemic. Course work for prospective primary school teachers in the…

The study investigates secondary students' attitude towards junior school certificate (JSC) examination in Bangladesh. The study is mainly quantitative and data was collected in a computable manner through questionnaires. Secondary students who would take the JSC examination were the main data source of the study. Two hundred fifty students (120…

This classroom experiment investigates the effects of adding representational pictures to multiple-choice and constructed-response test items to understand the role of the response format for the multimedia effect in testing. Participants were 575 fifth- and sixth-graders who answered 28 science test items--seven items in each of four experimental…

This study analyzed design and technological issues encountered by online course instructors as they taught 120 online courses while working with a designated instructional designer. After developing the courses and their approval in compliance with a set, standardized rubric, the implementation of the 120 courses brought out issues that required…

Our study is on developing mathematics items for Computer-Based Testing (CBT) using Tablet PC. These items are subject-based items using interactive dynamic objects. The purpose of this study is to obtain some suggestions for further tasks drawing on field test results for developed items. First, we clarified the role of the interactive dynamic…

This study analyzed design and technological issues encountered by online course instructors as they taught 120 online courses while working with a designated instructional designer. Having developed the courses and having had them approved in compliance with a set, standardized rubric, implementation of the 120 courses brought out issues that…

This study is part of a larger design study that iteratively improves a robotics programming curriculum as well as a computational thinking (CT) instrument. Its focus was majorly on CT assessment and particularly on an online CT instrument with logging functionality that can store a student's problem-solving process by recording interactions…

The purpose of this study is to develop a multi-dimensional scale to measure students' awareness of key competencies for M-learning and to test its reliability and validity. The Key Competencies of Mobile Learning Scale (KCMLS) was determined via confirmatory factor analysis to have four dimensions: team collaboration, creative thinking, critical…

This paper illustrates the application of existing guidelines to develop a test grounded in theoretical perspectives and empirical findings in the area of problem solving. By documenting this process, the paper outlines the challenges test developers face when seeking to construct a theory/research-driven test, discusses the decisions made at…

Complex Problem Solving (CPS) skills are essential to successfully deal with environments that change dynamically and involve a large number of interconnected and partially unknown causal influences. The increasing importance of such skills in the 21st century requires appropriate assessment and intervention methods, which in turn rely on adequate…

An online performance-based measure of persistence was developed using anagrams and riddles. Persistence was measured by recording the time spent on unsolved anagrams and riddles. Time spent on unsolved problems was correlated to a self-report measure of persistence. Additionally, frequent video game players spent longer times on unsolved problems…

Background: Complex problem-solving competence is regarded as a key construct in science education. But due to the necessity of using interactive and intransparent assessment procedures, appropriate measures of the construct are rare. This paper consequently presents the development and validation of a computer-based problem-solving environment,…