The multitrait-multimethod (MTMM) paradigm is used widely to assess construct validity, but D. A. Kenny and D. A. Kashy (1992) lament that even after 30 years we still do not know how to analyze MTMM data. The Composite Direct Product (CDP) model has recently attracted considerable attention. Its strengths and weaknesses are evaluated, and a…

This study evaluated the validity of the Type A behavior pattern as measured by paper-and-pencil questionnaires. The Jenkins Activity Survey, Framingham Type A Scale, Thurstone Activity Scales, a new bipolar adjective Type A measure, and measures of achievement and nurturance needs were completed by 418 students. (Author/BS)

Investigated use of the broad-band construct negative affectivity with children's self-report measures of depression, anxiety, and anger. Conducted a multitrait-multimethod analysis to intercorrelate self-report measures with the Child Behavior Checklist-Teacher Report Form (CBCL-TRF). Significant correlations occurred among the self-report…

Seven hierarchical clustering methods were applied to the Wechsler Adult Intelligence Scale-Revised (WAIS-R) scores of 121 medical rehabilitation clients to investigate the possibility of method-dependent results and determine the stability of the clusters. This multiple-methods cluster analysis suggests that the underlying constructs of the…

Common approaches to examining the relationship between multitrait-multimethod (MTMM) data and variables outside the MTMM data are compared: averaging various means of each trait and estimating LISREL computer program models, and estimating only relationships between MTMM traits and the outside variables. Problems of correlational bias are…

Using hierarchical confirmatory factor analysis to analyze multitrait-multimethod data, the validity of the Satisfaction with My Supervisor Scale (SWMSS) was evaluated by comparing the SWMSS to commitments to the organization, department, and occupation for 100 professional employees of a multinational software firm. The validity of the SWMSS was…

Studied the convergent and discriminant validity of multiple measures of perceived competence and obtained 12 separate multitrait-multimethod (MTMM) data sets for 1,228 children in grades 3 through 8. Examined the bias inherent in appraisals of children's competence and estimated manifest and latent variable mean differences between boys and girls…

The purpose of this study was to investigate convergent and discriminant validity of the five-factor model of adolescent personality in a school setting using three different raters (methods): self-ratings, peer ratings, and teacher ratings. The authors investigated validity through a multitrait-multimethod matrix and a confirmatory factor…

Researchers sometimes need a statistical test of the hypothesis that two values of Cronbach's alpha reliability coefficient are equal. The situation may involve scores from two different measures administered to independent random samples or from the same measure administered to random samples from two different populations. Feldt derived a test…

This multimethod study generated and tested a "best evidence" model of school improvement processes (SIP) capable of improving student achievement. Initially developed through the review of a comprehensive body of previous empirical research, the model was further refined through a 2, 5-year longitudinal study in 10 schools. A quantitative test of…

A multitrait-multimethod study collected measures of social-cognitive flexibility, crystallized social knowledge, and academic problem solving from 169 high school seniors. Results support a division of social-cognitive intelligence into declarative and procedural social knowledge (crystallized) and flexible knowledge application as distinct from…

Agreement between two independent reviews of each of 278 manuscripts was compared on an overall recommendation and on specific rating items. Agreement between reviewers on separate dimensions, the unweighted sum of the dimensions, and various weighted sums was no better than that for the overall recommendation itself. (SLD)

Method effects as a source of construct invalidity were evaluated for parent, teacher, and child ratings of problem behaviors among 489 children and adolescents with serious emotional disturbances. Multitrait multimethod analysis indicated large method effects for each rater. Such effects may be measurement artifact, situational differences, or…

Compares holistic scoring of nonnative writing in English with multiple trait assessment and scoring. (JL)

Investigation of the use of a multiple-trait scoring procedure to obtain communicative writing profiles of adult nonnative English speakers found that the scoring method was highly reliable in composite assessment, but provided little psychometric support for assessing certain individual writing components. (28 references) (Author/CB)