Running Records are thought to be an excellent formative assessment tool because they generate results that educators can use to make their teaching more responsive. Despite the technical nature of scoring Running Records and the kinds of important decisions that are attached to their analysis, few studies have investigated assessor accuracy. We…

As computer-based testing becomes more prevalent, the attention paid to response time (RT) in assessment practice and psychometric research correspondingly increases. This study explores the rate of Type I error in detecting preknowledge cheating behaviors, the power of the Kullback-Leibler (KL) divergence measure, and the L person fit statistic…

Background/purpose: This study aimed to reveal the accuracy of estimation of multiple-choice test items parameters following the models of the item-response theory in measurement. Materials/methods: The researchers depended on the measurement accuracy indicators, which express the absolute difference between the estimated and actual values of the…

Equating is a statistical procedure used to adjust for the difference in form difficulty such that scores on those forms can be used and interpreted comparably. In practice, however, equating methods are often implemented without considering the extent to which two forms differ in difficulty. The study aims to examine the effect of the magnitude…

When cross-examining witnesses, lawyers will sometimes use complex questions to "trip-up" witnesses and thus cast doubt on their testimony. Extending prior research, the present study showed that multifaceted test questions (which contain both a true and false proposition) reduced accuracy for both misled and control participants but had…

Accurate metacognitive monitoring improves performance in a variety of naturalistic contexts. However, the laboratory contexts used to study metacognition differ from naturalistic environments in important ways. Specifically, laboratory experiments require learners to make repeated, overt judgments that are thought to reflect underlying…

In three experiments, we sought to understand when and why people use an algorithm decision aid. Distinct from recent approaches, we explicitly enumerate the algorithm's accuracy while also providing summary feedback and training that allowed participants to assess their own skills. Our results highlight that such direct performance comparisons…

Background: Flying accuracy is influenced by pilots' affective reactions to task demands. A better understanding of task-related emotions and flying performance is needed to enhance pilot training. Objective: Understand pilot trainees' performance and emotional dynamics (intensity, frequency and variability) based on training phase and difficulty…

This study explored the impact of oxidation-reduction reaction problem difficulty on university students' cognitive load using event-related potentials (ERPs). Forty-eight balanced low and high difficulty problems were designed. Fifteen undergraduate students majoring in chemistry (8 females and 7 males) participated in the study. Results…

Unfolding models are frequently used to develop scales for measuring attitudes. Recently, unfolding models have been applied to examine rater severity and accuracy within the context of rater-mediated assessments. One of the problems in applying unfolding models to rater-mediated assessments is that the substantive interpretations of the latent…

Rubrics, which are designed to inform learners about assessment criteria and quality levels concerning a task assignment, are a widely used means to support learners in self-assessing their task performance. Usually, rubrics enhance task performance. Surprisingly, however, relatively little is known about the underlying mechanisms via which…

This study aims to evaluate ChatGPT's capabilities in certain numerical analysis problem: solving ordinary differential equations. The methodology which is developed in order to conduct this research takes into account the following mathematical abilities (defined according to National Centre for Education Statistics): Conceptual Understanding,…

Prospective memory (PM) refers to the ability to remember to complete a task at the appropriate moment in the future. Past research has found reminders can improve PM performance in both laboratory and naturalistic settings, but few projects have examined the circumstances when and what types of reminders are most beneficial. Three experiments in…

The present study explored the accuracy of participants' (N = 317) metacognitive awareness (self-reported difficulty and confidence) of psychology concepts and the moderating effects of their psychology background (academic major, number of psychology courses completed, and overall psychology course grades). Participants first rated the difficulty…

Background: We examined linguistic features in fourth graders' narrative and opinion writing and their relations to writing quality. We analysed narrative and opinion essays in terms of lexical sophistication and diversity as well as syntactic complexity, syntactic accuracy, and morphological complexity. Methods: Data were from English-speaking…