In evaluation, the whole is greater than the sum of the parts when quantitative and qualitative approaches and methods are combined. Some circumstances in which both approaches can be effectively combined are considered, and case studies of two evaluations using multiple methods are presented. (LMO)

Whether 12 university students could discriminate validly between the correctness and originality of responses of 150 elementary school children to 3 creativity tests was studied as a determination of the discriminant validity of the tests through the multitrait-multimethod procedure. There was compelling evidence for convergent and discriminant…

Examined the usefulness of a multiple-stage screening procedure in identifying youth experiencing elevated levels of anxiety. Children in grades 4-7 completed a 3-stage screening procedure. Results paralleled outcomes for when the procedure was used to recognize depressed children. Concludes that multiple-stage screening can identify children…

Conflicting evidence regarding listening comprehension as a separate trait in language proficiency is reviewed. Two studies conducted in Japan are presented that use the multitrait-multimethod methodology to examine the construct validity of the listening trait. (74 references) (Author/LB)

Used a multitrait-multimethod approach to investigate the validity of scores on locally prepared performance assessments taken by 6,000 third and fourth graders in reading, language arts, and mathematics. A partial explanation for the lack of construct validity evidence for the performance assessment scores is the probable low reliability of…

In this article we present a cognitive-ecological model for understanding and preventing emotional and behavioral difficulties and propose directions for school-based intervention programs, particularly with aggressive children. In the cognitive-ecological framework, intervention efforts should target certain cognitive skills (e.g., skills that…

This paper introduces the Website Acceptability Tiered Checklist (WATCH), a preliminary version of a multi-trait scale that could be used by instructors and students to assess the quality of websites chosen as source materials in students' research papers in a Humanities program. The scale includes bands for assessing: (i) the authority and…

This study is concerned with evaluating critical learning of 10-11 year-old students studying global citizenship through an online discussion environment. The evaluation is based on analysing the use of language as both a social reasoning tool and cognitive learning tool. Evaluation methods use: (1) content analysis of the online discussion…

The authors analyzed the domain specificity of emotions and focused on experiences of enjoyment, anxiety, and boredom in the domains of mathematics, Latin, German, and English. On the basis of assumptions in R. Pekrun's (2000; in press) control-value theory and findings of pilot studies, the authors hypothesized the existence of a largely…

Several multivariate statistical methodologies have been proposed to ensure objective and quantitative evaluation of the multitrait-multimethod matrix. The paper examines the performance of confirmatory factor analysis and covariance component models. It is shown, both empirically and formally, that confirmatory factor analysis is not a reliable…

The relationship of multiple linear regression to various multivariate statistical techniques is discussed. The importance of the standardized partial regression coefficient (beta weight) in multiple linear regression as it is applied in path, factor, LISREL, and discriminant analyses is emphasized. The multivariate methods discussed in this paper…

Assessed the convergent and discriminant validity of various measures of family cohesion and control, using a multitrait, multimethod approach. Families with at least one adolescent and in family therapy completed self-report measures and engaged in Reiss' Card Sort Procedure. Ratings of the families' cohesiveness were also obtained from the…

A study was conducted to compare three methods of assessing course-level self-efficacy beliefs within a multitrait multimethod (MTMM) framework. The methods involved: (1) successfully performing a number of domain-related tasks; (2) obtaining specific letter grades in the course; and (3) successfully performing generic academic tasks in the…

This study explored the possibility of using the Multi-Trait Multi-Method (MTMM) approach of D. Campbell and D. Fiske (1959) to examine the educational ecology of classrooms. Using the MTMM approach, the study focuses on the extent to which multiple methods of inquiry (surveys, drawings, and videos) are valid indicators of classroom teaching and…

In an extension of research on the Marsh/Shavelson model of self-concept, a set of 14 academic self-concept scales was related to school performance in 8 subjects for 507 Australian high school boys. Findings indicate that components of academic self-concept are more differentiated and content-specific than assumed. (SLD)