This article presents a general-purpose method for detecting cheating in online courses, which combines anomaly detection and supervised machine learning. Using features that are rooted in psychometrics and learning analytics literature, and capture anomalies in learner behavior and response patterns, we demonstrate that a classifier that is…

In the early years, it has become essential to support the acquisition of computational thinking, which is seen as a 21st-century skill and new literacy. A valid and reliable measurement tool is needed to develop and evaluate educational practices related to these skills. "TechCheck" is a validated unplugged assessment of computational…

The Perceptions of Inclusion Questionnaire (PIQ) assesses the perceptions of inclusion in 3rd to 9th grade students through three scales: social inclusion, emotional inclusion, and academic self-concept. This study aimed to establish the psychometric properties of the Spanish version of the instrument (PIQ-Spa) since no prior formal validation of…

In response to a call for research on using the SATs and ACTs for U.S.-based college and university admissions, researchers systematically interrogated the literature surrounding both tests, using a framework for validity evidence built upon the "Standards of Educational and Psychological Testing" and Kane's contemporary view of…

In this perspective, the authors critically examine "rater training" as it has been conceptualized and used in medical education. By "rater training," they mean the educational events intended to "improve" rater performance and contributions during assessment events. Historically, rater training programs have focused…

Diagnostic tests are typically administered in a multiple-choice (MC) format due to their advantages of objectivity and time efficiency. The MC-deterministic input, noisy "and" gate (DINA) family of models, a representative class of cognitive diagnostic models for MC items, efficiently and parsimoniously estimates the mastery profiles of…

Problem Statement: Among individuals aged 12 years or older, 14.3% (40.0 million) reporting the use of an illicit drug in the previous year. Given the prevalence of drug abuse, it is increasingly important to determine effective screening practices, treatment procedures, and best practices among various subpopulations to identify drug use-related…

Double-scoring constructed-response items is a common but costly practice in mixed-format assessments. This study explored the impacts of Targeted Double-Scoring (TDS) and random double-scoring procedures on the quality of psychometric outcomes, including student achievement estimates, person fit, and student classifications under various…

Background: Behavioural problems in individuals with intellectual disabilities have a negative impact on them. Limited assessment measures exist in Spain. This study aimed to validate the Behavior Problems Inventory--Short Form (BPI-S) in the Spanish population by examining its psychometric properties and factorial structures. Method: This study…

Purpose: The goal of the current study was to conduct a substantive validity review of four autism knowledge assessments with prior psychometric support (Gillespie-Lynch in J Autism and Dev Disord 45(8):2553-2566, 2015; Harrison in J Autism and Dev Disord 47(10):3281-3295, 2017; McClain in J Autism and Dev Disord 50(3):998-1006, 2020; McMahon…

Based on previous research, it can be assumed that teachers' self-efficacy (TSE) varies across situations, domains and individual students' behaviors confronting teachers with particularly challenging tasks. The construct of student-specific TSE is considered informative theoretical basis for understanding the relationship between…

Student attitudes are one of the fundamental factors that influence their achievement in the educational context. This study aimed to investigate the psychometric properties of Jordanian university students' attitudes towards blended learning. The sample for the study consisted of 843 Jordanian university students who were enrolled in blended…

Emotion regulation (ER) is a crucial construct in the study of child education, development, and psychopathology. The How I Feel (HIF) questionnaire, a self-report measure of ER for children, was validated in school-based, nonclinical samples. The current study examined the factor structure of the HIF in a clinical sample of children (N = 195;…

Mixed-format assessments made up of multiple-choice (MC) items and constructed response (CR) items that are scored using rater judgments include unique psychometric considerations. When these item types are combined to estimate examinee achievement, information about the psychometric quality of each component can depend on that of the other. For…

Conceptualizing and testing factors that contribute to the success of community-academic partnerships are critical to understanding their contributions to the health and well-being of communities. Most measures to date focus on factors that contribute to the development of new partnerships, and only a few have been adequately tested and validated.…