If psychometrics has long concerned itself with validity, reliability, and fairness, then what could psychometrics learn from the cybernetic theories of AI? Through engagement with Burstein's (2023) Responsible AI Standards, this paper unpacks some paradigmatic differences between psychometrics and cybernetics, points to how recursivity and…

This article presents a general-purpose method for detecting cheating in online courses, which combines anomaly detection and supervised machine learning. Using features that are rooted in psychometrics and learning analytics literature, and capture anomalies in learner behavior and response patterns, we demonstrate that a classifier that is…

Academic incivility is a serious concern for higher education. The continuum of incivility to bullying is not agreed upon, but the behaviors associated with these constructs disrupt education at every level. Unaddressed, these behaviors can significantly complicate teaching and learning conditions for students, faculty, and institutions. Acts of…

Dynamic Item Response Models extend the standard Item Response Theory (IRT) to capture temporal dynamics in learner ability. While these models have the potential to allow instructional systems to actively monitor the evolution of learner proficiency in real time, existing dynamic item response models rely on expensive inference algorithms that…

Computer adaptive testing (CAT) is an increasingly common mode of test administration offering improved test security, better measurement precision, and the potential for shorter testing experiences. This article presents a new item selection algorithm based on a generalized objective function to support multiple types of testing conditions and…

With the increasing use of automated scores in operational testing settings comes the need to understand the ways in which they can yield biased and unfair results. In this paper, we provide a brief survey of some of the ways in which the predictive methods used in automated scoring can lead to biased, and thus unfair automated scores. After…

This article is concerned with a subset of numerically stable and scalable algorithms useful to support computationally complex psychometric models in the era of machine learning and massive data. The subset selected here is a core set of numerical methods that should be familiar to computational psychometricians and considers whitening transforms…

In a time when the value of a college degree is under continuous scrutiny and the opportunity for alternate pathways to workforce readiness is ever-increasing, ensuring high-quality credentials is imperative. However, how can we reassure our students, employers, and other stakeholders that what we offer is high quality? To answer this question, we…

We review common situations in Bayesian latent variable models where the prior distribution that a researcher specifies differs from the prior distribution used during estimation. These situations can arise from the positive definite requirement on correlation matrices, from sign indeterminacy of factor loadings, and from order constraints on…

This article reviews the administrative, scoring, and psychometric properties of the Wechsler Individual Achievement Test, Fourth Edition (WIAT-4, NCS Pearson, 2020). The WIAT-4 is one of the more commonly administered broadband measures of academic achievement. The instrument was determined to be well-conceptualized, and generally…

Despite substantial evidence for the link between an individual's intelligence and successful life outcomes, questions about what defines intelligence have remained the focus of heated dispute. The most common approach to understanding intelligence has been to investigate what performance on tests of intellect is and is not associated with. This…

Vocabulary knowledge plays an important role in language learning and language proficiency, but it is difficult to know how much of a role it plays without appropriate vocabulary measures. In this article, we first discuss learner vocabulary in our research on Korean as a second/foreign language. Unable to find appropriate measures for receptive…

This article reviews the embodied theoretical basis for the meaningful learning of abstract vocabulary and reviews selected educational programs that are theoretically based and have both success and promise for abstract vocabulary development. Abstract vocabulary is a mainstay of academic vocabulary, but its nature and educational development are…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

Postsecondary institutions, and particularly community colleges, are positioned well to train more and more of the nation's entry- and middle-skill workers. The New World of Work (NWoW), a program that promoted teaching and learning soft skills, was designed in 2012 and operated briefly in over 75 community colleges in California. The program…