There is a growing need to empirically evaluate the quality of online instructional interventions at scale. In response, some online learning platforms have begun to implement rapid A/B testing of instructional interventions. In these scenarios, students participate in series of randomized experiments that evaluate problem-level interventions in…

In a 1993 book review, E. Pearlstein asks, "Why don't textbook authors begin their discussion of magnetism by talking about magnets? That's what students have experience with." A similar question can be asked, "Why don't professors have students measure the force between permanent magnets in introductory physics labs?" The…

Operations and Supply Chain Management (OSCM) courses may cover supply chain strategies, supply chain classification, and supply chain performance. Familiarity with various manufacturing and logistics firms would help students to better understand such topics. Information on the Dow Jones Industrial Average indexed firms and top 50 supply chain…

We introduce a model which combines principles from psychometric and connectionist paradigms to allow direct Q-matrix refinement via backpropagation. We call this model dAFM, based on augmentation of the original Additive Factors Model (AFM), whose calculations and constraints we show can be exactly replicated within the framework of neural…

Increasingly, learning in science and mathematics is considered in terms of induction into the multimodal language practices of the disciplinary community. A strong strand of research in this tradition has involved students being challenged to invent multimodal language forms, and their ideas refined through structured guidance. Often, however,…

Simulation studies are fundamental to psychometric discourse and play a crucial role in operational and academic research. Yet, resources for psychometricians interested in conducting simulations are scarce. This Instructional Topics in Educational Measurement Series (ITEMS) module is meant to address this deficiency by providing a comprehensive…

This work developed the Flint, Michigan water crisis as a modular case study for teaching traditional analytical chemistry concepts through the medium of environmental justice, power, and equity. An interdisciplinary framework was used to design, implement, and assess the case study in an effort to understand how the deliberate presence of…

In this article, we adjust the Kuk randomized response model for collecting information on a sensitive characteristic for increased protection and efficiency by making use of forced "yes" and forced "no" responses. We first describe Kuk's model and then the proposed adjustment to Kuk's model. Next, by means of a simulation…

The practical need for multidimensional measures of fidelity of implementation (FOI) of reform-based science, technology, engineering, and mathematics (STEM) instructional materials, combined with a theoretical need in the field for a shared conceptual framework that could support accumulating knowledge on specific enacted program elements across…

As is the case for any statistical model, a multidimensional latent growth model comes with certain requirements with respect to the data collection design. In order to measure growth, repeated measurements of the same set of individuals are required. Furthermore, the data collection design should be specified such that no individual is given the…

Common source bias has been the focus of much attention. To minimize the problem, researchers have sometimes been advised to take measurements of predictors from one observer and measurements of outcomes from another observer or to use separate occasions of measurement. We propose that these efforts to eliminate biases due to common source…

Background: Businesses have been exposed to many positive accounts of the benefits of employee wellness to improve employee performance as well as reduce health and injury claims costs for the employer. However, many do not have the tools or experience to effectively demonstrate the benefits of a workplace wellness program for their own management…

Von Davier, Holland, and Thayer (2004) laid out a five-step framework of test equating that can be applied to various data collection designs and equating methods. In the continuization step, they presented an adjusted Gaussian kernel method that preserves the first two moments. This article proposes an alternative continuization method that…

[Slides] presented at the Annual Meeting of National Council on Measurement in Education (NCME) in San Diego, CA in April 2009. This presentation describes how the vehicles for gathering student evidence--task models and test specifications--are developed.

In this commentary, the author asks the analogous question, "where's the psychology?" Not because the authors of the focus article "Unique Characteristics of Diagnostic Classification Models: A Comprehensive Review of the Current State-of-the-Art" have not provided a solid review of the technical aspects of Diagnostic…