In this digital ITEMS module, Dr. Jacqueline Leighton and Dr. Blair Lehman review differences between think-aloud interviews to measure problem-solving processes and cognitive labs to measure comprehension processes. Learners are introduced to historical, theoretical, and procedural differences between these methods and how to use and analyze…

Assessment is fundamental to school psychology, but its purpose has shifted from making predictions about children to improving outcomes for children. This commentary on the special issue focuses on screening and progress-monitoring decisions that can be used to solve student problems. We outline several psychometric and practical issues that…

Abilities in scientific thinking and reasoning have been emphasized as core areas of initiatives, such as the Next Generation Science Standards or the College Board Standards for College Success in Science, which focus on the skills the future will demand of today's students. Although there is rich literature on studies of how these abilities…

A great deal of research in educational data mining is geared towards predicting student performance. Bayesian Knowledge Tracing, Performance Factors Analysis, and the different variations of these have been introduced and have had some success at predicting student knowledge. It is worth noting, however, that very little has been done to…

The subject of the research is to build methodologies to evaluate the student knowledge by testing. The author points to the importance of feedback about the mastering level in the learning process. Testing is considered as a tool. The object of the study is to create the test system models for defence practice problems. Special attention is paid…

To find out whether the education community shares a collective understanding about how students should be evaluated, we surveyed 202 educators (from all grade levels) and scientists attending assessment workshops (Pennsylvania, California, and Massachusetts) or judging a national student competition (Washington, DC). The educators and scientists…

This article addresses two unsolved measurement issues in dynamic problem solving (DPS) research: (a) unsystematic construction of DPS tests making a comparison of results obtained in different studies difficult and (b) use of time-intensive single tasks leading to severe reliability problems. To solve these issues, the MicroDYN approach is…

Quantitative literacy has been recognized as an important skill in the higher education and workforce communities, focusing on problem solving, reasoning, and real-world application. As a result, there is a need by various stakeholders in higher education and workforce communities to evaluate whether college students receive sufficient training on…

The influence of metacognition on learning and problem solving has been demonstrated, and it is becoming increasingly clear that promoting metacognitive activity can produce substantial improvements in problem solving and learning in chemistry. This article reports the development and validation of an instrument designed to evaluate students'…

For the past 3 yr, faculty at the University of New Mexico, Department of Biochemistry and Molecular Biology have been using interactive online Problem-Based Learning (PBL) case discussions in our large-enrollment classes. We have developed an illustrative tracking method to monitor student use of problem-solving strategies to provide targeted…

The Collegiate Learning Assessment (CLA) is a computer administered, open-ended (as opposed to multiple-choice) test of analytic reasoning, critical thinking, problem solving, and written communication skills. Because the CLA has been endorsed by several national higher education commissions, it has come under intense scrutiny by faculty members,…

This article describes the construction of a hierarchical taxonomy of metacognitive activities for the interpretation of thinking-aloud protocols of students in secondary education, who studied texts on history and physics. After testing an initial elaborate taxonomy on a restricted number of protocols by multiple raters, it appeared that the…

Reviews five simulation methods used in medical and health science education: oral examinations, live simulated patients, mannequins, and written and computer-based simulations. Each type of simulation is discussed relative to its fidelity, reliability, validity, learning, and feasibility. (MBR)

In this article, the authors explain how curriculum-based measurement (CBM) differs from other forms of classroom-based assessment. The development of CBM is traced from computation to concepts and applications to real-life problem solving, with examples of the assessments and illustrations of research to document technical features and utility…

This article summarizes the important ideas and research findings of DISCOVER, an on-going program of research and development concerning the problem solving abilities of children and youth. It identifies five problem types and reviews the DISCOVER assessment model, including research on its reliability and validity and the DISCOVER curriculum…