To address needs in one US state to provide a professional development micro-credential for tens of thousands of educators, we automated an assignment scoring workflow in an online course by developing and refining an AI model to scan submitted assignments and score them against a rubric. This article outlines the AI model development process and…

Administrative problems such as computer malfunction and power outage occasionally lead to missing item scores and hence to incomplete data on mastery tests such as the AP and U.S. Medical Licensing examinations. Investigators are often interested in estimating the probabilities of passing of the examinees with incomplete data on mastery tests.…

In recent years, online teaching has become extremely popular. Most institutions of higher learning are offering online courses in almost every field of study. Teaching any course online is challenging, but teaching quantitative courses, such as operations management, management science, statistics, and others, have added a more challenging…

The process of implementing intensive reading interventions using data-based decision-making (DBDM) becomes increasingly challenging as students move into the secondary grades and reading tasks correspondingly become more complex. This article provides teachers with guidelines to support effective implementation of DBDM for students with or at…

In sequential mastery testing (SMT), assessment via computer is used to classify examinees into one of two mutually exclusive categories. Unlike paper-and-pencil tests, SMT has the capability to use variable-length stopping rules. One approach to shortening variable-length tests is stochastic curtailment, which halts examination if the probability…

After a brief review of recent advances in sequential analysis involving sequential generalized likelihood ratio tests, we discuss their use in psychometric testing and extend the asymptotic optimality theory of these sequential tests to the case of sequentially generated experiments, of particular interest in computerized adaptive testing. We…

Sequential mastery testing (SMT) has been researched as an efficient alternative to paper-and-pencil testing for pass/fail examinations. One popular method for determining when to cease examination in SMT is the truncated sequential probability ratio test (TSPRT). This article introduces the application of stochastic curtailment in SMT to shorten…

Introduces a theoretical framework for mastery testing, using Item Response Theory and Bayesian Decision Theory. The idea of sequential testing is developed, with the goal of providing longer or shorter tests as needed, and a computerized application to a hypothetical professional knowledge examination is discussed. (Author/LRW)

This article describes Minnesota Computerized Adaptive Testing Language program code for using the MicroCAT 3.5 testing software to administer several types of self-adapted tests. Code is provided for: a basic self-adapted test; a self-adapted version of an adaptive mastery test; and a restricted self-adapted test. (Author/SLD)

A new computerized mastery test is described that builds on the Lewis and Sheehan procedure (sequential testlets) (1990), but uses fuzzy set decision theory to determine stopping rules and the Rasch model to calibrate items and estimate abilities. Differences between fuzzy set and Bayesian methods are illustrated through an example. (SLD)

Discusses the use of computerized adaptive testing (CAT) in the classroom. Highlights include item response theory; sequential probability ratio test (SPRT); combining SPRT with expert system reasoning, resulting in EXSPRT; and a study of college students that examined the efficiency and accuracy of the various CAT methods discussed. (Contains 16…

A procedure is introduced for determining the effect of testlet nonequivalence on operating characteristics of a testlet-based computerized mastery test (CMT). The procedure, which involves estimating the CMT decision rule twice with testlet likelihoods treated as equivalent or nonequivalent, is demonstrated with testlet pools from the Architect…

A theoretical framework for mastery testing based on item response theory and Bayesian decision theory is described and illustrated. Implementation depends on the availability of (1) a computerized test delivery system; (2) a pool of pretested items; and (3) a model relating observed test performance to true mastery status. (SLD)

Examines ways in which intelligent tutoring systems can be used to develop models of a student's domain knowledge, problem solving abilities, and learning strategies. Cognitive skills assessment is discussed, and an example of a problem based tutoring system, Qualitative Understanding of Electrical System Troubleshooting (QUEST), is explained. (25…

Demonstrates how Bayesian reasoning can be used to adjust the length of computer-guided practice exercises and computer-based tests to help make mastery or nonmastery decisions. Individualization of instruction is discussed, and the results of an empirical study that used the sequential probability ratio test (SPRT) are presented. (25 references)…