This article presents a general-purpose method for detecting cheating in online courses, which combines anomaly detection and supervised machine learning. Using features that are rooted in psychometrics and learning analytics literature, and capture anomalies in learner behavior and response patterns, we demonstrate that a classifier that is…

The NAEP EDM Competition required participants to predict efficient test-taking behavior based on log data. This paper describes our top-down approach for engineering features by means of psychometric modeling, aiming at machine learning for the predictive classification task. For feature engineering, we employed, among others, the Log-Normal…

This essay describes Rasch analysis psychometric techniques and how such techniques can be used by life sciences education researchers to guide the development and use of surveys and tests. Specifically, Rasch techniques can be used to document and evaluate the measurement functioning of such instruments. Rasch techniques also allow researchers to…

Measuring Early Learning Quality & Outcomes (MELQO) was initiated to address needs for child development and quality of early childhood education (ECE) data, specifically for low- and middle-income countries. Drawing from existing tools, MELQO convened a consortium to create open-source tools to be adapted to national contexts, simultaneously…

This paper briefly discusses four measurement challenges of data science or "big data" in educational assessments that are enabled by technology: 1. Dealing with change over time via time-based data. 2. How a digital performance space's relationships interact with learner actions, communications and products. 3. How layers of…

Bi-factor analysis is a form of confirmatory factor analysis originally introduced by Holzinger and Swineford ("Psychometrika" 47:41-54, 1937). The bi-factor model has a general factor, a number of group factors, and an explicit bi-factor structure. Jennrich and Bentler ("Psychometrika" 76:537-549, 2011) introduced an exploratory form of bi-factor…

The purpose of this report is to describe the technical qualities of the 2018-2019 operational administration of the English language arts/literacy (ELA/L) and mathematics summative assessments in grades 3 through 8 and high school. The ELA/L assessments focus on reading and comprehending a range of sufficiently complex texts independently and…

The purpose of this report is to describe the technical qualities of the 2018-2019 operational administration of the English language arts/literacy (ELA/L) and mathematics assessments in grades 3 through 8 and high school. New Meridian, in coordination with multiple states and vendors, developed an alternate form of the summative assessment to…

This special issue of "JEDM" was dedicated to bridging work done in the disciplines of "educational and psychological assessment" and "educational data mining" (EDM) via the assessment design and implementation framework of "evidence-centered design" (ECD). It consisted of a series of five papers: one…

The essay integrates the psychometric intelligence approach with the cognitive-developmental approach or the stage theory erected by Piaget and his disciples. The latter led to Piagetian Cross-Cultural Psychology and the accumulation of an immense body of data. It shows that different IQ levels are indicative of the peculiar stages of cognitive…

In recent years the educational community has increasingly embraced digital technologies for the purposes of developing alternative learning environments, providing diagnostic feedback, and fostering the development of so-called 21st-century skills. This special issue is dedicated to bridging recent work from the disciplines of educational and…

This monograph provides a psychological rational for the novel field of "Educational Science" and how it conducts in-depth research investigations first presented in an article by the author in the i-manager's "Journal on Mathematics" through the trichotomous analysis of the affective domain. Educational Science uses the…

A new class of parametric models that generalize the multivariate probit model and the errors-in-variables model is developed to model and analyze ordinal data. A general model structure is assumed to accommodate the information that is obtained via surrogate variables. A hybrid Gibbs sampler is developed to estimate the model parameters. To…

We propose the development of a "population" of high-quality assessment tasks that cover the performance goals set out in the "Common Core State Standards for Mathematics." The population will be published. Tests are drawn from this population as a structured random sample guided by a "balancing algorithm."

Effective teaching has long been an issue of national concern, but in recent years focus on the effectiveness of programs to produce high-quality teachers has sharpened. Long-standing achievement gaps persist despite large-scale legislative changes at the federal and state levels, and American students continue to show poorer performance on…