Cultural differences between faculty and their students can create important challenges that affect the quality and efficacy of online teaching and learning. The objectives of this study were to: (a) create and pilot test an assessment for online faculty to measure culturally responsive teaching knowledge (CRT) and culturally responsive…

Provides alternatives to the definitions of additive and multiplicative method effects in multitrait-multimethod data given by D. Campbell and E. O'Connell (1967). The alternative definitions can be formulated by means of constraints in the parameters of the correlated uniqueness model (H. Marsh, 1989). (SLD)

A mixed-method conceptual framework was developed from the literature and refined through an analysis of 57 empirical mixed-method evaluations. Five purposes for mixed-method evaluation are identified (triangulation, complementarity, development, initiation, and expansion) and analyzed using the framework of 7 design characteristics. (TJH)

Surveys, content analyses, and laboratory experiment/judgment task strategies continue to be the dominant research methods used in mass communication research. Some researchers, however, are advocating method triangulation--the use of at least two and as many as five methods within the same study. A manual and computer search of several databases…

The Developmental Indicators for the Assessment of Learning-Revised (DIAL-R) and the Learning Accomplishment Profile-Diagnostic (LAP-D) were compared using 121 children in a Head Start Program. Results suggest that profile interpretations of the scales may not differentiate skill domains and that these scales may be indicative of general…

Two of the most widely used academic self-efficacy assessment techniques, problem-referenced measurement and the Motivated Strategies for Learning Questionnaire (MSLQ) were compared. Participants were 383 high school students from 4 Los Angeles (California) schools. Multi-trait multi-method analyses revealed that the two techniques were not…

The growth of educational teams in collaborative reform initiatives spurs a need for team assessments to assist in promoting functional team environments, productive team work, and member satisfaction. This study applied a multitrait-multimethod framework (D. Campbell and D. Fiske, 1959) to assess team functioning and team leadership. Four case…

There is widespread concern about the use and abuse of alcohol and other drugs by adolescents and young adults. It has yet to be determined whether drug use in itself is invariably associated with disruptive or problem use of drugs. Additionally, drug use may vary by frequency and quantity of ingestion which may be differentially related to…

Several multivariate statistical methodologies have been proposed to ensure objective and quantitative evaluation of the multitrait-multimethod matrix. The paper examines the performance of confirmatory factor analysis and covariance component models. It is shown, both empirically and formally, that confirmatory factor analysis is not a reliable…

The relationship of multiple linear regression to various multivariate statistical techniques is discussed. The importance of the standardized partial regression coefficient (beta weight) in multiple linear regression as it is applied in path, factor, LISREL, and discriminant analyses is emphasized. The multivariate methods discussed in this paper…

A study was conducted to compare three methods of assessing course-level self-efficacy beliefs within a multitrait multimethod (MTMM) framework. The methods involved: (1) successfully performing a number of domain-related tasks; (2) obtaining specific letter grades in the course; and (3) successfully performing generic academic tasks in the…

This study explored the possibility of using the Multi-Trait Multi-Method (MTMM) approach of D. Campbell and D. Fiske (1959) to examine the educational ecology of classrooms. Using the MTMM approach, the study focuses on the extent to which multiple methods of inquiry (surveys, drawings, and videos) are valid indicators of classroom teaching and…

The way in which trait and rater variance combine in multitrait-multirater (MTMR) performance appraisal data is explored. Implications of the confirmatory factor analytic model and the composite direct product (CDP) model for MTMR data are examined. Superior fit of the CDP model for four data sets is discussed. (SLD)

Extending research on the Marsh/Shavelson model of self-concept, a set of 14 academic self-concept scales was related to school performance in 8 school subjects for a sample of 507 high school students. Correlations between matching areas of self-concept and achievement (0.45 to 0.70; mean r=.57) were substantial and larger than correlations…

A science laboratory skills performance assessment for elementary and secondary school science teachers in California, using a multi-methods approach, is described. Seven domains of teacher performance identified included: pedagogy, content, materials and equipment, management, knowledge of students, climate, and communication. Within each domain,…