It is common practice for assessment programs to organize qualifying sessions during which the raters (often known as "markers" or "judges") demonstrate their consistency before operational rating commences. Because of the high-stakes nature of many rating activities, the research community tends to continuously explore new…

When using linear models for cluster-correlated or longitudinal data, a common modeling practice is to begin by fitting a relatively simple model and then to increase the model complexity in steps. New predictors might be added to the model, or a more complex covariance structure might be specified for the observations. When fitting models for…

The Rasch latent trait model was applied to investigate the relationship of performance on Raven items to expectations for individuals at different levels of the underlying scale. The use of Rasch model in instances of small samples and issues related to the interpretation of the model to Raven-type data are discussed. (DWH)

Several methods for the analysis of three-way data (data classified three ways) are described and shown to be variants of principal components analysis of the two-way supermatrix in which each two-way slice is strung out into a column vector. Direct fitting and fitting derived data are considered. (SLD)

Two recent indices of fit, the Relative Noncentrality Index (RNI) (R. P. McDonald and H. W. Marsh, 1990) and the Comparative Fit Index (P. M. Bentler, 1990), are shown to be algebraically equivalent in most applications, although one condition in which the RNI may be advantageous for model comparison is identified. (SLD)

If one is given three or more methods of measuring three or more traits, the procedure described allows one to assess the extent to which the observation is influenced by the method and the extent to which individual differences contribute to the observations, independent of the particular method-trait combination. The procedure is illustrated.…

A basic methodological approach in developmental studies is the collection of longitudinal data. Behavioral data cen take at least two forms, qualitative (or discrete) and quantitative. Both types are fallible. Measurement errors can occur in quantitative data and measures of these are based on error variance. Qualitative or discrete data can…

The way in which trait and rater variance combine in multitrait-multirater (MTMR) performance appraisal data is explored. Implications of the confirmatory factor analytic model and the composite direct product (CDP) model for MTMR data are examined. Superior fit of the CDP model for four data sets is discussed. (SLD)

Several goodness of fit (GOF) criteria have been developed to assist the researcher in interpreting structural equation models. However, the determination of GOF for structural equation models is not as straightforward as that for other statistical approaches in multivariate procedures. The four GOF criteria used across the commonly used…

Title I evaluations using the RMC Model C design depend for their interpretation on the assumption that the regression of posttest on pretest is linear across the cut score level when there is no treatment; but there are many instances where nonlinearities may occur. If one applies the analysis of covariance, or model C analysis, large errors may…

Evaluations of social programs based upon quasi-experimental designs are typically plagued by problems of nonequivalence between the experimental and comparison group prior to the experiment. In such settings it is extremely difficult, if not impossible, to isolate the effects of the program from the confounding effects associated with the…

This paper discusses the use of the LISREL computer program to compare two groups of Ontario students who studied French as a second language in either a regular or an immersion program. Longitudinal data on growth in mathematical ability, from grade 4 to grade 6, are analyzed using seven different mathematical models. The paper illustrates the…

This partially annotated bibliography of journal articles, dissertations, convention papers, research reports, and a few books and unpublished manuscripts provides a comprehensive coverage of work on latent trait theory and practice. Documents are arranged alphabetically by author. The period covered ranges from the early 1950's to the present.…