There is evidence to suggest that the effects of behavioral interventions may be limited to specific types of individuals, but methods for evaluating such outcomes have not been fully developed. This study proposes the use of finite mixture models to evaluate whether interventions, and, specifically, group randomized trials, impact participants…

A linear combination of a set of measures is often sought as an overall score summarizing subject performance. The weights in this composite can be selected to maximize its reliability or to maximize its validity, and the optimal choice of weights is in general not the same for these two optimality criteria. We explore several relationships…

Evaluated external assessor ratings of the quality of the research team and the proposed research for proposals submitted to the Australian Research Council large grants program. Data from 313 evaluations show that the reliability of the assessments varied systematically with the number of assessors and the score considered. Discusses implication…

A method for examining invariance in validity of multiple-component instruments in repeated measure designs is outlined. The approach is developed within the framework of covariance structure modeling and is applicable for purposes of ascertaining temporal stability in scale validity. In addition, the procedure provides a range of plausible values…

Two longitudinal studies involving 29 raters concerning the construct validity, temporal stability, and interrater reliability of the latent common factors underlying subjective assessments by human raters of personality traits in the stumptail macaque and the zebra finch illustrate the use of generalizability analysis to test prespecified…

The factorial validity of the Maslach Burnout Inventory (MBI) and the equivalence of factorial measurements and structure across groups were studied for 163 intermediate-grade teachers, 162 secondary school teachers, and 218 university teachers in Canada. Reasons why the MBI may not be appropriate for university educators are discussed. (SLD)