Response process data have the potential to provide a rich description of test-takers' thinking processes. However, retrieving insights from these data presents a challenge for educational assessments and educational data mining as they are complex and not well annotated. The present study addresses this challenge by developing a computational…

Previous research has demonstrated the potential of examining log-file data from computer-based assessments to understand student interactions with complex inquiry tasks. Rather than solely providing information about what has been achieved or the accuracy of student responses ("product data"), students' log files offer additional…

Collaboration is a complex skill, comprised of multiple subskills, that is of growing interest to policy makers, educators and researchers. Several definitions and frameworks have been described in the literature to support assessment of collaboration; however, the inherent structure of the construct still needs better definition. In 2015, the…

Collaborative problem solving (CPS) assessment is a new academic research field with a number of educational implications. In 2015, the Programme for International Student Assessment (PISA) assessed CPS with a computer-simulated human-agent (H-A) approach that claimed to measure 12 individual CPS skills for the first time. After reviewing the…

Program for International Student Assessment results indicate that while reading comprehension needs to be promoted, teachers are struggling to find ways to motivate students to do reading comprehension activities and although technology-enhanced learning approaches are entering the classroom, researchers are still experimenting with them to…

The purpose of this study was to investigate the influence of worked examples using virtual manipulatives on the learning performance and attitudes of fifth grade students toward mathematics. The results showed that: (1) the utilization of non-routine examples could promote learning performance of equivalent fractions. (2) Learning with virtual…

Current science assessments typically present a series of isolated fact-based questions, poorly representing the complexity of how real-world science is constructed. The National Research Council asserts that this needs to change to reflect a more authentic model of science practice. We strongly concur and suggest that good science assessments…

This study used innovative assessment practices to obtain and document broad learning outcomes for a 15-hour game-based curriculum in Quest Atlantis, a multi-user virtual environment that supports school-based participation in socio scientific inquiry in ecological sciences. Design-based methods were used to refine and align the enactment of…

Empirical results from two studies--a simulation study and an experimental one--indicated that, in achievement data of the problem-solving type where a specific subject matter area is being tested, the greater the variety of the algorithms used, the higher the dimensionality of the test data. (Author/PN)

Scholastic achievement tests and mental ability tests normally consist of a set of multiple choice items, all of which are assumed to measure school-relevant cognitive abilities. The presumption, in a given test situation, is that the answers/solutions to the given tasks represent cognitive capabilities on the part of the examinees. The purpose of…

This project was composed of two major research experiments and four subsidiary experiments, designed to test alternative ways of constructing and applying occupational problem-solving materials. In Part I, Difficulty Level of Simulated Vocational Problems in Encouraging Career Exploration, it was found that the difficulty level did significantly…