Access to high-quality education at scale is limited by the difficulty of providing student feedback on open-ended assignments in structured domains like programming, graphics, and short response questions. This problem has proven to be exceptionally difficult: for humans, it requires large amounts of manual work, and for computers, until…

The Remote Associates Test is a well-established measure, frequently used to assess individuals' creative abilities, as a function of the ability to elicit remote associates. The nature of the involved associative processes is still poorly understood. This hampers a deeper understanding of the creative process, rendering it difficult to determine…

We tested a method for solving Bayesian reasoning problems in terms of spatial relations as opposed to mathematical equations. Participants completed Bayesian problems in which they were given a prior probability and two conditional probabilities and were asked to report the posterior odds. After a pretraining phase in which participants completed…

Confidence and its accuracy have been most commonly examined in domains such as general knowledge and learning, with less study of other domains, such as applied knowledge and problem solving. Monitoring accuracy in real-world competencies may depend on characteristics of the domain. In this study, we examined whether monitoring accuracy, both…

Assessment is fundamental to school psychology, but its purpose has shifted from making predictions about children to improving outcomes for children. This commentary on the special issue focuses on screening and progress-monitoring decisions that can be used to solve student problems. We outline several psychometric and practical issues that…

This paper attempts to quantify the accuracy limit of "nextitem-correct" prediction by using numerical optimization to estimate the student's probability of getting each question correct given a complete sequence of item responses. This optimization is performed without an explicit parameterized model of student behavior, but with the…

This paper reports some experiments on probabilistic reasoning designed to investigate the impact of the probabilistic problem presentation format (verbal-numerical and graphical-pictorial) on subjects' confidence in the correctness of their performance, other than the calibration between confidence and accuracy. To understand the potential effect…

Much of our real-life decision making is bounded by uncertain information, limitations in cognitive resources, and a lack of time to allocate to the decision process. It is thought that humans overcome these limitations through "satisficing," fast but "good-enough" heuristic decision making that prioritizes some sources of…

Bayesian techniques have become increasingly present in the social sciences, fueled by advances in computer speed and the development of user-friendly software. In this paper, we forward the use of Bayesian Asymmetric Regression (BAR) to monitor intervention responsiveness when using Curriculum-Based Measurement (CBM) to assess oral reading…

In the modern world information has become the new power. An increasing amount of efforts are being made to gather data, resources being allocated, time being invested and tools being developed. Data collection is no longer a myth; however, it remains a great challenge to create value out of the enormous data that is being collected. Data modeling…