Multiple traits of language proficiency as well as test method effects were concurrently analyzed to investigate interrelations of construct validity, convergent validity, and discriminant validity using multitrait-multimethod (MTMM) matrices. A total of 585 test takers' scores were derived from the field test of the "Pearson Test of English…

Research on work as a calling is limited by measurement concerns. In response, the authors introduce the multidimensional Calling and Vocation Questionnaire (CVQ) and the Brief Calling scale (BCS), instruments assessing presence of, and search for, a calling. Study 1 describes CVQ development using exploratory and confirmatory factor analysis…

A major stumbling block for emotional intelligence (EI) research has been the lack of adequate evidence for discriminant validity. In a sample of 280 dyads, self- and peer-reports of EI and Big Five personality traits were used to confirm an a priori four-factor model for the Wong and Law Emotional Intelligence Scale (WLEIS) and a five-factor…

The Social and Character Development (SACD) research program was designed to evaluate the effectiveness of seven elementary-school-based programs developed to promote social and emotional competence, positive behavior, a positive school climate, and academic achievement, and to decrease negative behavior. Procedures undertaken by the SACD…

The present study investigated the factor structure of a field trial sample of the Test of English as a Foreign Language™ Internet-based test (TOEFL® iBT). An item-level confirmatory factor analysis (CFA) was conducted for a polychoric correlation matrix of items on a test form completed by 2,720 participants in the 2003-2004 TOEFL iBT Field…

This simulation investigates bias in trait factor loadings and intercorrelations when analyzing multitrait-multimethod (MTMM) data using the correlated uniqueness (CU) confirmatory factor analysis (CFA) model. A theoretical weakness of the CU model is the assumption of uncorrelated methods. However, previous simulation studies have shown little…

This study examined the factor structure of the parent and teacher versions of the Strengths and Difficulties Questionnaire (SDQ; R. Goodman, 1997) with a sample of first-grade children at risk for educational failure. The 5-factor model previously found in studies using exploratory factor analysis was fit to the data for both parent and teacher…

Seven hierarchical clustering methods were applied to the Wechsler Adult Intelligence Scale-Revised (WAIS-R) scores of 121 medical rehabilitation clients to investigate the possibility of method-dependent results and determine the stability of the clusters. This multiple-methods cluster analysis suggests that the underlying constructs of the…

The purpose of this study was to investigate convergent and discriminant validity of the five-factor model of adolescent personality in a school setting using three different raters (methods): self-ratings, peer ratings, and teacher ratings. The authors investigated validity through a multitrait-multimethod matrix and a confirmatory factor…

Reexamines a 49-year-old study of P technique applied to a psychotherapy patient with a recurrent physical symptom. Explores dimensions of psychotherapeutic change as well as the context for the recurrent symptom. Illustrates the contributions from applying the P technique to psychotherapy research, to psychosomatic medicine, and to personality…

Several multivariate statistical methodologies have been proposed to ensure objective and quantitative evaluation of the multitrait-multimethod matrix. The paper examines the performance of confirmatory factor analysis and covariance component models. It is shown, both empirically and formally, that confirmatory factor analysis is not a reliable…

Describes a new approach for analyzing an individual's responses made at multiple times. Proposes that three sources of variance determine a person's current standing on a variable: trait (term does not change), state (term changes), and error (random term). Shows how structural equation modeling can be used and presents an extended example. (RJM)

Construct validity of a prototype baccalaureate generic problem solving skills test was explored through a structural analysis. The assessment method used three real-life problem situations crossed by six generic skills, namely Decision-Making, Communication, Analysis, Synthesis, Valuing and Execution. There were six written responses for each…

Assigned factor scores to therapist and client utterances. Constructed a 17 x 17 correlation matrix consisting of correlations across 4 lagged utterances. Principal-components analysis revealed 4 therapist-client interaction factors: mutual therapeutic engagement, mutual therapeutic negotiation, undirected client reminiscence, and sustained…

The advantages of applying confirmatory factor analysis (CFA) to multitrait-multimethod (MTMM) data are widely recognized. However, because CFA as traditionally applied to MTMM data incorporates single indicators of each scale (i.e., each trait/method combination), important weaknesses are the failure to: (1) correct appropriately for measurement…