At present, research on computational thinking in universities is gaining interest, and more attention is being paid to the cultivation and teaching of computational thinking. However, there is a lack of computational thinking assessment tools for college students, which makes it difficult to understand the current status and development of their…

This article is concerned with the statistical detection of copying on multiple-choice exams. As an alternative to existing permutation- and model-based copy-detection approaches, a simple randomization p-value (RP) test is proposed. The RP test, which is based on an intuitive match-score statistic, makes no assumptions about the distribution of…

The current study examined whether the learning benefits of pretesting--like those produced by posttesting--generalize to classroom settings, and whether such benefits transfer to non-pretested related information. Before some lectures but not others, undergraduate students enrolled in a large research methods class were given a brief competitive…

Two-stage testing (TST) involves individual testing followed by taking the same test in teams. Previously, Vogler and Robinson ("The Journal of Experimental Education," 84(4), 787-803, 2016) found that TST facilitated individual performance. The present study addressed methodological limitations in the Vogler and Robinson study in two…

We discuss the development and validation of the long version of a conceptual multiple-choice survey instrument called the Survey of Thermodynamic Processes and First and Second Laws-Long suitable for introductory physics courses. This version of the survey instrument is a longer version of the original shorter version developed and validated…

The testlet design is very popular in educational and psychological assessments. This article proposes a new cognitive diagnosis model, the multiple-choice cognitive diagnostic testlet (MC-CDT) model for tests using testlets consisting of MC items. The MC-CDT model uses the original examinees' responses to MC items instead of dichotomously scored…

Emotional intelligence (EI) has a positive correlation with the academic performance of medical students. However, why there is a positive correlation needs further exploration. We hypothesized that the capability of answering higher-order knowledge questions (HOQs) is higher in students with higher EI. Hence, we assessed the correlation between…

Multiple-response questions are a common feature of survey-based research, as its advantages of information collection are well known. Statistical analysis of the responses, however, tends to be either one or two-dimensional, with the restrictions that this entails. This paper presents a multidimensional analysis protocol that provides the…

In tertiary mathematics courses, students often have difficulties acquiring an understanding of the mathematical concepts covered. One approach to address this problem is to implement so-called Concept-Tests. These are multiple-choice questions whose distractors represent common problems and misconceptions related to the concepts. While there…

The study used phenomenology to examine teacher candidates' metaphorical perceptions for measurement and evaluation practices in distance education. 210 teacher candidates at a foundation university in Istanbul were included in the study group. Researchers collected data using a three-part form. The first part gathered demographic information, the…

Despite extensive studies on large language models and their capability to respond to questions from various licensed exams, there has been limited focus on employing chatbots for specific subjects within the medical curriculum, specifically medical neuroscience. This research compared the performances of Claude 3.5 Sonnet (Anthropic), GPT-3.5 and…

Digital administration of assessments allows for the collection of process data indices, such as response time, which can serve as indicators of rapid-guessing and examinee test-taking effort. Setting a time threshold is essential to distinguish effortful from effortless behavior using item response times. Threshold identification methods may…

This study examines students' format-specific expectations and their preferences toward (1) written multiple-choice examinations, (2) written constructed-response examinations, (3) oral examinations, and (4) standardized practical examinations. N = 509 medical students completed a web-based survey, rating all four examination formats. Preferences…

A better understanding of how distractor features influence the plausibility of distractors is essential for an efficient multiple-choice (MC) item construction in educational assessment. The plausibility of distractors has a major influence on the psychometric characteristics of MC items. Our analysis utilizes the nominal categories model to…

This research utilizes a unique, validated, multiple-choice exam design that allows researchers to observe and measure the degree to which students copy answers from their peers. Using data collected from the exam, this study investigates whether asking students to sign an honor code at the start of the exam reduced instances of cheating relative…