Retrieval practice with particular items from memory can impair the recall of related items on a later memory test. This retrieval-induced forgetting effect has been ascribed to inhibitory processes (M. C. Anderson & B. A. Spellman, 1995). A critical finding that distinguishes inhibitory from interference explanations is that forgetting is found…

We use clustering, an analysis method not presently common to the physics education research community, to group and characterize student responses to written questions about two-dimensional kinematics. Previously, clustering has been used to analyze multiple-choice data; we analyze free-response data that includes both sketches of vectors and…

This state-of-the-art review describes the genesis, structure, methods, applications, limitations and goals of the ordering analytic approach to hierarchical analysis, with specific reference to its relevance and use in educational, psychology and behavioral sciences. Hierarchy is defined as an "ordering" of objects such that the…

This paper compares two methods of estimating component difficulties for dichotomous test data. Simulated data are used to study the effects of sample size, collinearity, a measurement disturbance, and multidimensionality on the estimation of component difficulties. (RB)

This study explored the dangers of item theft in terms of impact on test quality and fairness. Simulations were used to explore the impact of item theft on test taker scores. In the simulation, a simulated, organized group of thieves took the test, memorized the items received, and distributed the items to future test takers. Impact was explored…

The purpose of this study was to assess the dimensionality of attitudinal data arising from unfolding models for discrete data and to compute rough estimates of item and individual parameters for use as starting values in other estimation parameters. One- and two-dimensional simulated test data were analyzed in this study. Results of limited…

The four items on the scale that favored the Down syndrome Ss all involved figural content and visual-motor ability. The five items that favored the non-Down syndrome Ss generally involved semantic content, social intelligence, general comprehension, and/or judgment and reasoning. (Author/SB)

Presents three components of the tests with instructional feedback on slides system (TIFS), the needs of the three, background on the production of the test item reference card, and the advantage of the system for both instructor and student. (MER)

Explains different ways to use National Assessment of Educational Progress (NAEP) test items for classroom assessment. Presents examples from 4th grade questions. (SOE)

A formally simple expression for the maximal reliability of a linear composite is provided. Its theoretical implications and its relation to existing results for reliability are discussed. (Author/SLD)

Identifies and evaluates alternative methods for weighting tests. Presents formulas for composite reliability and validity as a function of component weights and suggests a rational process that identifies and considers trade-offs in determining weights. Discusses drawbacks to implicit weighting and explicit weighting and the difficulty of…

Presents six computational methods based on mixed-integer programming for assembling tests from a bank with an item-set structure and evaluated these methods using mathematical programming feasibiity and expected solution times. Illustrates these methods with two data sets from the Law School Admission Test. Discusses the best approximations to…

Investigated the usefulness of multidimensional scaling (MDS) for assessing the dimensionality of dichotomous test data. Focused on two MDS proximity measures, one based on the PC statistic (T. Chen and M. Davidson, 1996) and other, on interitem Euclidean distances. Simulation results show that both MDS procedures correctly identify…

The purpose of this note is twofold: (a) to present the formula for the item information function (IIF) in any direction for the Multidimensional 3-Parameter Logistic (M3-PL) model and (b) to give the equation for the location of maximum item information (theta[sub max]) in the direction of the item discrimination vector. Several corollaries are…

In an Angoff standard-setting procedure, judges estimate the probability that a hypothetical randomly selected minimally competent candidate will answer correctly each item constituting the test. In many cases, these item performance estimates are made twice, with information shared with the judges between estimates. Especially for long tests,…