If psychometrics has long concerned itself with validity, reliability, and fairness, then what could psychometrics learn from the cybernetic theories of AI? Through engagement with Burstein's (2023) Responsible AI Standards, this paper unpacks some paradigmatic differences between psychometrics and cybernetics, points to how recursivity and…

This article presents a general-purpose method for detecting cheating in online courses, which combines anomaly detection and supervised machine learning. Using features that are rooted in psychometrics and learning analytics literature, and capture anomalies in learner behavior and response patterns, we demonstrate that a classifier that is…

Academic incivility is a serious concern for higher education. The continuum of incivility to bullying is not agreed upon, but the behaviors associated with these constructs disrupt education at every level. Unaddressed, these behaviors can significantly complicate teaching and learning conditions for students, faculty, and institutions. Acts of…

Computer adaptive testing (CAT) is an increasingly common mode of test administration offering improved test security, better measurement precision, and the potential for shorter testing experiences. This article presents a new item selection algorithm based on a generalized objective function to support multiple types of testing conditions and…

Vocabulary knowledge plays an important role in language learning and language proficiency, but it is difficult to know how much of a role it plays without appropriate vocabulary measures. In this article, we first discuss learner vocabulary in our research on Korean as a second/foreign language. Unable to find appropriate measures for receptive…

This article builds upon a proiminent definition of construct validity that focuses on variation in attributes causing variation in measurement outcomes. This article synthesizes the defintion and uses Rasch measurement modeling to explicate a modified conceptualization of construct validity for assessments of developmental attributes. If…

This article presents the consensus of an National Council on Measurement in Education Presidential Task Force on Foundational Competencies in Educational Measurement. Foundational competencies are those that support future development of additional professional and disciplinary competencies. The authors develop a framework for foundational…

Psychometrics is the field of designing tests and assessments to measure certain psychological concepts. It is chiefly concerned with two fundamental properties: reliability and validity. These properties are often influenced by confounding variables: other things that can influence performance but are not what you are trying to measure. Here, I…

Creating an inclusive experience for students in Higher Education is important for their engagement, belonging, and attainment. There are multiple ways of approaching inclusive teaching and there are specific considerations to be addressed when considering a Psychology curriculum. Although pedagogical resources discuss the benefits and abstract…

This book is a comprehensive introduction to the topic of assessing students who use two or more languages in their daily life. The book provides foundational information for assessing multilingual learners (MLs) in schools, with an emphasis on school language and content. Major assessment ideas are viewed through a framework called PUMI (Purpose,…