As COVID-19 spread in early 2020, a lockdown was implemented across Canadian provinces and territories, resulting in the shuttering of physical post-secondary campuses. Universities quickly pivoted to remote learning, and faculty members adjusted their instructional and assessment approaches to align with virtual environments. Presumably to aid…

In this article, we describe a software system for assessment development in online learning environments in contexts where there are robust links to cognitive modelling including domain and student modelling. BEAR Assessment System Software (BASS) establishes both a theoretical basis for the domain modelling logic, and offers tools for delivery,…

Assessment is prevalent throughout all levels of education in the United States. Even though educators are familiar with the idea of assessing students, familiarity does not necessarily ensure assessment literacy, or data-based decision making (DBDM) knowledge. Assessment literacy and DBDM are critical in education, and early childhood education…

There is an increasing interest in reporting test subscores for diagnostic purposes. In this article, we review nine popular R packages (subscore, mirt, TAM, sirt, CDM, NPCD, lavaan, sem, and OpenMX) that are capable of implementing subscore-reporting methods within one or more frameworks including classical test theory, multidimensional item…

New data-driven technologies appear to promise a new era of accuracy and objectivity in scientifically-informed educational policy and governance. The data-scientific objectivity sought by education policy, however, is the result of practices of standardization and quantification deployed to settle controversies about the definition and…

Factor analysis has been frequently exploited in applied research to provide evidence about the underlying factors in various measurement instruments. A close inspection of a large number of studies published in leading applied linguistic journals shows that there is a misconception among applied linguists as to the relative merits of exploratory…

The author--artist, scientist, educator, and visual-spatial thinker--describes the genesis of, and provides insight into, an innovative, strength-based, visually dynamic computer-aided communication system called Chandelier©. This system is the powerful combination of a sophisticated, user-friendly software program and an organizational…

Markov chain Monte Carlo (MCMC) methods enable a fully Bayesian approach to parameter estimation of item response models. In this simulation study, the authors compared the recovery of graded response model parameters using marginal maximum likelihood (MML) and Gibbs sampling (MCMC) under various latent trait distributions, test lengths, and…

Functional measurement studies typically collect numerical data in order to study judgment. The new Nanova (Nominal analysis of "variance") method allows for expansion of the paradigm to include the study of actual or projected behavior. In everyday life, people carry out actions that can be described using verbal labels, which are nominal data.…

This review describes and evaluates a software add-in created by Frontline Systems, Inc., that can be used with Microsoft Excel 2007 to solve large, complex test assembly problems. The combination of Microsoft Excel 2007 with the Frontline Systems Premium Solver Platform is significant because Microsoft Excel is the most commonly used spreadsheet…

In 2 Monte Carlo studies of fixed- and random-effects meta-analysis for correlations, A. P. Field (2001) ostensibly evaluated Hedges-Olkin-Vevea Fisher-[zeta] and Schmidt-Hunter Pearson-r estimators and tests in 120 conditions. Some authors have cited those results as evidence not to meta-analyze Fisher-[zeta] correlations, especially with…

This paper reports on the development of a scale for determining the quality of the student e-learning experience at the degree level when the student learning context is predominately a campus-based experience. Rapid developments in the use of information and communication technologies (ICT) in higher education require methods for evaluating the…

There are a number of measurement instruments in the field of education whose aims are to measure various aspects of educational technology. However, the psychometric properties of such instruments are not always determined, and their use is not always appropriate. The aim of this study was to determine the psychometric properties of the survey of…

Many credentialing agencies today are either administering their examinations by computer or are likely to be doing so in the coming years. Unfortunately, although several promising computer-based test designs are available, little is known about how well they function in examination settings. The goal of this study was to compare fixed-length…

Research on psychometric methods is heavily dependent on software. The quality, availability, and documentation of such software are critical to the advancement of the field. In 2000, an ad hoc committee of NCME recommended that NCME adopt policies that promote greater availability and better documentation of software. This article follows the ad…