In undergraduate mathematics education, students' collaborations have gained a reputation as a 'good' learning practice. A more complex image emerges once collaborations are construed as an arena where cognitive, social, and affective matters intertwine in ways that can fuel and impede learning. In this study, I take a close look at a…

The relationship between mathematics and spatial reasoning is well established and extensively researched. Certain mathematics content could be deemed explicitly spatial, for example within geometry. However, the link to spatial reasoning extends into other areas of mathematics, such as representations of the number line and reading and…

Computerized assessments and interactive simulation tasks are increasingly popular and afford the collection of process data, i.e., an examinee's sequence of actions (e.g., clickstreams, keystrokes) that arises from interactions with each task. Action sequence data contain rich information on the problem-solving process but are in a nonstandard,…

Open-ended tasks are common in Science, Technology, Engineering and Mathematics (STEM) education. However, as far as we know, no tools have been developed to assist in the assessment of the solution process of open-ended questions. In this paper, we propose the use of analysis of traces as a tool to address this need. To illustrate this approach,…

This study focused on the effect of examinees' ability levels on the relationship between Reflective-Impulsive (RI) cognitive style and item response time in computerized adaptive testing (CAT). The total of 56 students majoring in Educational Technology from Shandong Normal University participated in this study, and their RI cognitive styles were…

Solving non-routine problems is one of the most important skills for the 21st century. Traditional paper-pencil tests cannot assess this type of skill well because of their lack of interactivity and inability to capture procedural data. Tools such as MicroDYN and MicroFIN have proved to be trustworthy in assessing complex problem-solving…

Mastery behaviours -- seeking out challenging tasks and continuing to work on them despite difficulties -- are integral to achievement but difficult to measure with precision. The current study reports on the development and validation of the computer-based persistence, effort, resilience, and challenge-seeking (PERC) task in two demographically…

It was investigated how domain-specific knowledge, fluid intelligence, vocational interest and work-related self-efficacy predicted domain-specific problem-solving performance in the field of office work. The participants included 100 German VET (vocational education and training) students nearing the end of a 3-year apprenticeship program as an…

Complex Problem Solving (CPS) is seen as a cross-curricular 21st century skill that has attracted interest in large-scale-assessments. In the Programme for International Student Assessment (PISA) 2012, CPS was assessed all over the world to gain information on students' skills to acquire and apply knowledge while dealing with nontransparent…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…

An online performance-based measure of persistence was developed using anagrams and riddles. Persistence was measured by recording the time spent on unsolved anagrams and riddles. Time spent on unsolved problems was correlated to a self-report measure of persistence. Additionally, frequent video game players spent longer times on unsolved problems…

Background: Complex problem-solving competence is regarded as a key construct in science education. But due to the necessity of using interactive and intransparent assessment procedures, appropriate measures of the construct are rare. This paper consequently presents the development and validation of a computer-based problem-solving environment,…

The principle of "inversion," that a + b - b "must" equal a, is a fundamental property of arithmetic, but many children fail to apply it in symbolic contexts through 10 years of age. We explore three hypotheses relating to the use of inversion that stem from a model proposed by Siegler and Araya (2005). Hypothesis 1 is that…

This study examines the validity of the complex problem solving (CPS) test MicroDYN by investigating a) the relation between its dimensions--rule identification (exploration strategy), rule knowledge (acquired knowledge), rule application (control performance)--and working memory capacity (WMC), and b) whether CPS predicts school grades in…

The present study reports the basic characteristics of a game-like application entitled "Playing with Words-PwW". PwW is a single-user application where a word must be guessed given an anagram of that word. Anagrams are presented from a predefined word list and users can repeatedly try to guess the word, from which the anagram is…