A Monte Carlo simulation was used to examine pay-performance relationships. Conventional merit systems achieved a better link between pay and performance than bonus systems, because merit systems benefit from consistency of performance over time. Even very substantial errors in measurement of performance have only a modest effect on…

Describes a study used to determine differences in exam reliability, difficulty, and student evaluations. Indicates that when a fourth option was added to the three-option items, the exams became more difficult. Includes methods, results discussion, and tables on student characteristics, whole test analyses, and selected items. (RT)

Simulated data were used to investigate the performance of modified versions of the Mantel-Haenszel method of differential item functioning (DIF) analysis in computerized adaptive tests (CAT). Results indicate that CAT-based DIF procedures perform well and support the use of item response theory-based matching variables in DIF analysis. (SLD)

Regression to the mean (RTM) is often misunderstood. It is demonstrated that artifactual RTM depends fundamentally on the magnitude of measurement error at pretest. Adjustment usually involves estimating the measurement error and determining consequences, but even without adjustment, effects of RTM can be ameliorated. (SLD)

A generalized variance criterion is proposed to measure efficiency in item-response-theory (IRT) models. Heuristic arguments are given to formulate the efficiency of a design in terms of an asymptotic generalized variance criterion. Efficiencies of designs for one-, two-, and three-parameter models are compared. (SLD)

When repeated observations are taken at equal time intervals, a simple form of a stationary time series structure may be fitted to the observations. Use of correction factors is discussed. A computer simulation method is used to investigate power advantages of fitting a serial correlation pattern to repeated observations. (TJH)

A methodology is presented for minimizing mean error variance in generalizability studies when resource constraints are imposed. The optimal number of observations and conditions of facets for random model, fully crossed one- and two-facet designs can be decided. Parallel closed form formulas can be determined for other designs. (SLD)

Item parameter estimation errors in test development are highlighted. The problem is illustrated with several simulated data sets, and a conservative solution is offered for addressing the problem in item response theory test development practice. Steps that reduce the problem of capitalizing on chance in item selections are suggested. (SLD)

The importance of regression diagnostics in detecting influential data points is discussed, and five statistics are recommended for the applied researcher. The suggested diagnostics were used on a dataset of 24 subjects, and effects were analyzed. Colinearity-based diagnostics and diagnostics for a variety of procedures are discussed. (SLD)

Structural equation models merge multiple regression, path analysis, and factor analysis techniques into a single data analytic framework. Measurement models are developed to define latent variables, and structural equations are then established among the latent variables. Explains the development of these models. (KS)

Examined methodological issues related to the detection and evaluation of behavioral toxicity in infants and children, focusing on the selection of appropriate variables and strategies to control for confounding, sampling strategies and the problem of "overcontrol" for confounding; and the evaluation of dose-response relations and…

Weighting responses to Constructed-Response (CR) items has been proposed as a way to increase the contribution these items make to the test score when there is insufficient testing time to administer additional CR items. The effect of various types of weighting items of an IRT-based mixed-format writing examination was investigated.…

This article describes a Monte Carlo study of 2 methods for treating incomplete nonnormal data. Skewed, kurtotic data sets conforming to a single structured model, but varying in sample size, percentage of data missing, and missing-data mechanism, were produced. An asymptotically distribution-free available-case (ADFAC) method and structured-model…

In the current paper we describe the methodology and results of the Oswego study, in light of D.V. Cicchetti, A.S. Kaufman, and S.S. Sparrow's (this issue) criticisms regarding the validity of the human health/behavioral claims in the PCB literature. The Oswego project began as a replication of the Lake Michigan Maternal Infant Cohort study.…

Many do not consider the effect that missing data have on their survey results nor do they know how to handle missing data. This chapter offers strategies for handling item-missing data and provides a practical example of how these strategies may affect results. The chapter concludes with recommendations for preventing and dealing with missing…