Uses data from two different medical examinations to study how to collect enough information about candidates with minimal measurement error and reasonable confidence without asking examiners for redundant ratings. Results, using the FACETS program show the feasibility of using analytic ratings of clinical skills rather than holistic ratings. (SLD)

Restrictions due to loss of freedom in estimation, the targeting of the instrument, and the presence of misfit in the data were studied through simulation as factors that influence the asymptotic standard errors for person measures. The underestimation of the observed standard deviation of ability in simulated data is discussed. (SLD)

The use of structural equation modeling (SEM) with latent variables to address measurement error and to examine processes that may account for changes in observed outcomes in data from experimental studies is illustrated. An example from a Project Family study is provided; issues that arise in applying SEM procedures are discussed. (Author/EMK)

Classical test theory is founded on the proposition that measurement error, a random latent variable, is a component of the observed score random variable. This article traces the history of the development of classical test theory, beginning in the early 20th century. (SLD)

The Social Relations model of D. A. Kenny estimates variances and covariances from a round-robin of two-person interactions. This paper presents a matrix formulation of the Social Relations model, using the formulation to derive exact and estimated standard errors for round-robin estimates of Social Relations parameters. (SLD)

A research review supports the validity of the person-environment fit (PEF) model in vocational psychology; however, sampling inadequacies have influenced results. One PEF example, Holland's hexagonal model, is unsupported due to lack of commensurate measurement; most hexagonal congruence indices are invalid. (Contains 110 references.) (SK)

Includes "P-E [Person-Environment] Fit as Paradigm" (Dawis); "Pitfalls of Congruence Research" (Gati); "The Next Millennium of 'Fit' Research" (Hesketh); "Holland's Hexagon Is Alive and Well--Though Somewhat out of Shape" (Prediger); "Tinsley on Holland: A Misshapen Argument" (Rounds, McKenna,…

Synthesizes literature on performance assessment for individual-level, high-stakes tests and the error variance associated with a person x task interaction. Proposes a research agenda based on this literature. (SLD)

Glickman, Gray, and Morales (this issue) propose a statistical model for measuring the unobserved latency of stimulus-controlled processes. The model accounts for both speed and accuracy and does so by assuming that participants set an internal deadline. If a stimulus-controlled response is not produced by the deadline, the participant then…

Variants of adaptive Bayesian procedures for estimating the 5% point on a psychometric function were studied by simulation. Bias and standard error were the criteria to evaluate performance. The results indicated a superiority of (a) uniform priors, (b) model likelihood functions that are odd symmetric about threshold and that have parameter…

The information function is an important statistic in item response theory (IRT) applications. Although the information function is often described as the IRT version of reliability, it differs from the classical notion of reliability from a critical perspective: replication. This article first explores the information function for the…

In this simulation study, we investigate the power and Type I error rate of a procedure based on the mean and covariance structure analysis (MACS) model in detecting differential item functioning (DIF) of graded response items with five response categories. The following factors were manipulated: type of DIF (uniform and non-uniform), DIF…

Structural equation modeling allows several methods of estimating the disattenuated association between 2 or more latent variables (i.e., the measurement model). In one common approach, measurement models are specified using item parcels as indicators of latent constructs. Item parcels versus original items are often used as indicators in these…

The computation and reporting of effect size estimates is becoming the norm in many journals in psychology and related disciplines. Despite the increased importance of effect sizes, researchers may not report them or may report inaccurate values because of a lack of appropriate computational tools. For instance, Pierce, Block, and Aguinis (2004)…

The authors used a Monte Carlo simulation to examine how the violation of the exchangeability assumption affects empirical Type I error rates of the LMH randomization test (J. R. Levin, L. A. Marascuilo, & L. J. Hubert, 1978). Simulation results showed that the LMH test is not always an appropriate technique for analyzing systematic designs when…