This work investigates how people make judgments about the content of their visual working memory (VWM). Some studies on long-term memory suggest that people base those metacognitive judgments on the outcome of a retrieval attempt. In contrast, Son and Metcalfe (2005) observed that people identify poorly remembered items immediately, presumably by…

Low-stakes test performance commonly reflects examinee ability and effort. Examinees exhibiting low effort may be identified through rapid guessing behavior throughout an assessment. There has been a plethora of methods proposed to adjust scores once rapid guesses have been identified, but these have been plagued by strong assumptions or the…

College students in a lower-division psychology course made metacognitive judgments by predicting and postdicting performance for true-false, multiple-choice, and fill-in-the-blank question sets on each of three exams. This study investigated which question format would result in the most accurate metacognitive judgments. Extending Koriat's (1997)…

The test blueprint is important in test development, where it guides the test item writer in creating test items according to the desired objectives and specifications or characteristics (so-called a priori item characteristics), such as the level of item difficulty in the category and the distribution of items based on their difficulty level.…

Disengaged responding poses a severe threat to the validity of educational large-scale assessments, because item responses from unmotivated test-takers do not reflect their actual ability. Existing identification approaches rely primarily on item response times, which bears the risk of misclassifying fast engaged or slow disengaged responses.…

The purpose of this study comprises (1) calibrating the Basic Statistics Test for Indonesian undergraduate psychology students using the Rasch model, (2) testing the impact of adjustment for guessing on item parameters, person parameters, test reliability, and distribution of item difficulty and person ability, and (3) comparing person scores…

Identifying and considering test-taking effort is of utmost importance for drawing valid inferences on examinee competency in low-stakes tests. Different approaches exist for doing so. The speed-accuracy+engagement model aims at identifying non-effortful test-taking behavior in terms of nonresponse and rapid guessing based on responses and…

Multiple choice results are inherently probabilistic outcomes, as correct responses reflect a combination of knowledge and guessing, while incorrect responses additionally reflect blunder, a confidently committed mistake. To objectively resolve knowledge from responses in an MC test structure, we evaluated probabilistic models that explicitly…

A high percentage of bachelor test-takers who failed the unified entrance examination test in 2021 demonstrated the lack of adequate reading strategies such as contextual guessing for improving exam performance. The study aims at evaluating the use of contextual guessing strategy during extra-curriculum EFL classes as a way to improve students'…

Successfully retrieving information protects it against later forgetting. Failed retrieval attempts are also beneficial if followed by study of corrective feedback. To explain both of these findings, researchers have proposed the "mediation hypothesis." In the case of learning from corrective feedback, initial errors may serve as…

As researchers in the social sciences, we are often interested in studying not directly observable constructs through assessments and questionnaires. But even in a well-designed and well-implemented study, rapid-guessing behavior may occur. Under rapid-guessing behavior, a task is skimmed shortly but not read and engaged with in-depth. Hence, a…

Testwiseness may introduce construct-irrelevant variance to multiple-choice test scores. Presenting response options sequentially has been proposed as a potential solution to this problem. In an experimental validation, we determined the psychometric properties of a test based on the sequential presentation of response options. We created a strong…

This study is an exploratory analysis of examinee behavior in a large-scale language proficiency test. Despite a number-right scoring system with no penalty for guessing, we found that 16% of examinees omitted at least one answer and that women were more likely than men to omit answers. Item-response theory analyses treating the omitted responses…

Attempting to guess an answer to a memory question has repeatedly been shown to benefit memory for the answer compared to merely reading what the answer is, even when the guess is incorrect. In this study, we investigate 2 potential explanations for this effect in a single experimental procedure. According to the semantic explanation, the benefits…

This study aimed to examine freshmen and senior college students' episodic and semantic memory use in classroom context regarding short and long time delays and college experience level. Data were collected in 2014 and 2017, right after students' final exams (T1) and 5 weeks later (T2). Students were given exemplar questions from their final exams…