This study uses a multitrait, multimethod (MTMM) approach to investigate the genetic and environmental etiologies of childhood deviant peer affiliation (DPA) and problem behavior (PROB). The variability of genetic and environmental estimates by agent and method is also examined. A total of 77 monozygotic and 72 dizygotic twin pairs and each twin's…

A mixed-method conceptual framework was developed from the literature and refined through an analysis of 57 empirical mixed-method evaluations. Five purposes for mixed-method evaluation are identified (triangulation, complementarity, development, initiation, and expansion) and analyzed using the framework of 7 design characteristics. (TJH)

Data from four studies were used to analyze the hypothesis that performance evaluation variables can be constructed with a rater's facet and a trait's facet. The regularity of the pattern of intercorrelations across different rater groups was remarkable. The use of facet analysis before confirmatory analysis is discussed. (SLD)

A modification of the TUCKALS3 algorithm is proposed that handles three-way arrays of order I x J x K for any I. The reduced work space needed for storing data and increased execution speed make the modified algorithm very suitable for use on personal computers. (SLD)

Research on the direct-product model is extended by deriving hierarchically nested models for explicitly testing the patterns of method and trait factors and through formal tests developed for the pattern of communalities. These procedures are illustrated, and use of the MUTMUM computer program is discussed. (SLD)

A generalization of the single trait, multioccasion measurement model is provided through a confirmatory measurement model for multitrait-multioccasion (MTMO) data. Several commonly used confirmatory measurement models are contrasted with the MTMO, and it is illustrated with a large four-wave dataset on family support and alcohol involvement. (SLD)

This study compared four methods for setting item response time thresholds to differentiate rapid-guessing behavior from solution behavior. Thresholds were either (a) common for all test items, (b) based on item surface features such as the amount of reading required, (c) based on visually inspecting response time frequency distributions, or (d)…

By examining American University's Washington Semester Program (AUWSP), this project analyzes the impact of intensive undergraduate experiential and active learning on subsequent student academic performance. In this article, we discuss the differences between traditional, active, and experiential learning methods to better understand the…

The No Child Left Behind (NCLB) Act of 2001 requires that public schools adopt research-supported programs and practices, with a strong recommendation for randomized controlled trials (RCTs) as the "gold standard" for scientific rigor in empirical research. Within that policy framework, this paper compares the relative utility of…

Cognitive engagement in self-regulated learning was investigated at the levels of component cognitive processes and sets of these components (acquisition and transformation) by collecting data on the cognition of 33 high school seniors. Multitrait-multimethod analyses reveal that measures of self-regulated learning are not coherent. (SLD)

The Leadership Attitudes and Beliefs Scale was studied in 65 males and 111 females between 19 and 22 years old. Results supported the convergent and discriminantive validity of the Systemic Thinking scale and the divergent and discriminantive validity of the Hierarchical Thinking scale. (Contains 61 references and 2 tables.) (GCP)

This paper describes the validation of actual and preferred forms of a new classroom environment instrument--the Technology-Rich Outcomes-Focused Learning Environment Inventory (TROFLEI)--using multitrait-multimethod modelling. The 80-item TROFLEI assesses 10 classroom environment dimensions: Student Cohesiveness, Teacher Support, Involvement,…

The multitrait-multimethod (MTMM) design of D. T. Campbell and D. W. Fiske (1959) is the most widely used paradigm for testing construct validity, but it continues to be plagued by problems associated with definition of terms, operationalizations of their guidelines, and analytic procedures used to test them. Using five diverse MTMM data sets,…

Presents results from two studies that investigate the measurement of childhood depression through self-report and reports from others. Results were discussed in terms of the need to consider self-report in the discussion of depression with its covert components and in terms of the need for improved measurement instruments. (BH)

Knowledge mapping is expected to measure deep conceptual understanding and allow students to characterize relationships among concepts in a domain visually. This research examined the validity of knowledge mapping as an assessment tool in science. The approach to investigating this validity was three-pronged. First, a model was outlined for the…