When a self-report instrument includes a balanced number of positively and negatively worded items, factor analysts often use method factors to aid model fitting. The nature of these factors, often referred to as acquiescence, is still debated. Relying upon previous results (Alessandri et al., 2010; DiStefano & Motl, 2006, 2008; Rauch, Schweizer,…

Diagnostic scores are of increasing interest in educational testing due to their potential remedial and instructional benefit. Naturally, the number of educational tests that report diagnostic scores is on the rise, as are the number of research publications on such scores. This article provides a critical evaluation of diagnostic score reporting…

The noncentral chi-square approximation of the distribution of the likelihood ratio (LR) test statistic is a critical part of the methodology in structural equation modeling. Recently, it was argued by some authors that in certain situations normal distributions may give a better approximation of the distribution of the LR test statistic. The main…

A method for point and interval estimation of change in criterion validity of multiple-component measuring instruments as a result of revision is outlined. The procedure is developed within the framework of covariance structure modeling, which complements earlier methods for testing change in composite reliability due to addition or deletion of…

This study used multilevel modeling of daily diary data to model within-person (state) and between-person (trait) components of coping variables. This application included the introduction of multilevel factor analysis (MFA) and a comparison of the predictive ability of these trait/state factors. Daily diary data were collected on a large (n =…

This article provides the theory and application of the 2-stage maximum likelihood (ML) procedure for structural equation modeling (SEM) with missing data. The validity of this procedure does not require the assumption of a normally distributed population. When the population is normally distributed and all missing data are missing at random…

Double cross-validation of a test battery against multiple criterion variables found the first general factor accounts for most criterion variance in cross-validated regression weights. Small contributions are made by mechanical/technical and psychomotor factors. It appears a common general factor plays the major role in validity for a range of…

The structural validity of the Index of Organizational Reactions (IOR)--an eight-factor job satisfaction scale--was investigated via confirmatory factor analysis. Results of first- and second-order factor analyses of data concerning a stratified random sample of 445 employees of a large financial institution are reported. (TJH)

Evaluated a cross-validation approach for cluster analyses through two simulation studies. Although on the average replication indices peaked in the region of the true number of clusters, choosing the number of clusters by maximum replication results in a negatively biased estimate. Using a "scree test" to attenuate this bias is…

In regression analysis, the notion of population validity is of theoretical interest for describing the usefulness of the underlying regression model, whereas the presumably more important concept of population cross-validity represents the predictive effectiveness for the regression equation in future research. It appears that the inference…

Speeded cognitive processing tasks involving card sorting and reaction time were administered to 141 young adults aged 18 to 33 and to 142 elderly adults aged 58 to 73. Confirmatory factor analysis was unsuccessful, but independent analyses revealed different factors for the two age groups. (Author/GDC)

Presents a simple method for generating simulated plasmodes and artificial test clusters with user-defined shape, size, and orientation. For "J" clusters, indicator validity is defined as the squared correlation ratio between the cluster indicator and J-1 dummy variables. Illustrates the method through simulation. (SLD)

There is evidence to suggest that the effects of behavioral interventions may be limited to specific types of individuals, but methods for evaluating such outcomes have not been fully developed. This study proposes the use of finite mixture models to evaluate whether interventions, and, specifically, group randomized trials, impact participants…

A linear combination of a set of measures is often sought as an overall score summarizing subject performance. The weights in this composite can be selected to maximize its reliability or to maximize its validity, and the optimal choice of weights is in general not the same for these two optimality criteria. We explore several relationships…

Three potential applications of stepwise procedures in canonical analysis and several alternative stepping decision rules are described. Results of an empirical investigation of the procedures indicated that more parsimonious approaches to maintaining variables held up better under cross-validation. (Author/JKS)