We offer a new conceptualization and measurement models for constructs at the group-level of analysis in small group research. The conceptualization starts with classical notions of group behavior proposed by Tönnies, Simmel, and Weber and then draws upon plural subject theory by philosophers Gilbert and Tuomela to frame a new perspective…

Recent Monte Carlo research has illustrated that the traditional method for assessing the construct-related validity of assessment center (AC) post-exercise dimension ratings (PEDRs), an application of confirmatory factor analysis (CFA) to a multitrait-multimethod matrix, produces inconsistent results [Lance, C. E., Woehr, D. J., & Meade, A. W.…

The analysis of convergent and discriminant validity is an integral part of the construct validation process. Models for analyzing the convergent and discriminant validity have typically been developed for cross-sectional data. There exist, however, only a few approaches for longitudinal data that can be applied for analyzing the construct…

This article argues that a mixed methods approach is useful in understanding the complexity that underlies teachers' commitment to environmental education. Using sequential and concurrent procedures, the authors demonstrate how different methodological approaches highlighted different aspects of teacher commitment. The quantitative survey examined…

During the last 15 years, there has been a steady increase in the popularity and sophistication of the confirmatory factor analysis approach to multitrait-multimethod (MTMM) data. However, important problems exist, the most serious being the ill-defined solutions that plague MTMM studies and the assumption that so-called method factors primarily…

Goal orientation research has developed two branches. One branch uses a two-factor dispositional model. The other branch uses a three-factor domain-specific model. The present multiwave study examines dispositional goal orientation constructs through both two and three-factor models using repeated-measure confirmatory factor analysis. Results…

Compared alternative methods for examining relationship between two constructs and estimated true relationship between social skill and depression. Data from 68 subjects suggest that multitrait-multimethod data sets, analyzed via confirmatory factor-analytic techniques, can greatly enhance theory testing and development. (Author/NB)

The multitrait-multimethod (MTMM) paradigm is used widely to assess construct validity, but D. A. Kenny and D. A. Kashy (1992) lament that even after 30 years we still do not know how to analyze MTMM data. The Composite Direct Product (CDP) model has recently attracted considerable attention. Its strengths and weaknesses are evaluated, and a…

Method effects as a source of construct invalidity were evaluated for parent, teacher, and child ratings of problem behaviors among 489 children and adolescents with serious emotional disturbances. Multitrait multimethod analysis indicated large method effects for each rater. Such effects may be measurement artifact, situational differences, or…

This study investigated construct validity and factorial invariance of a performance assessment of reading comprehension and writing proficiency through a multitrait-multimethod (MTMM) structure using confirmatory factor analysis. The performance assessment was administered to 1,023 fifth and sixth graders. Interrater reliability was examined for…