The purpose of this study was to investigate convergent and discriminant validity of the five-factor model of adolescent personality in a school setting using three different raters (methods): self-ratings, peer ratings, and teacher ratings. The authors investigated validity through a multitrait-multimethod matrix and a confirmatory factor…

By examining American University's Washington Semester Program (AUWSP), this project analyzes the impact of intensive undergraduate experiential and active learning on subsequent student academic performance. In this article, we discuss the differences between traditional, active, and experiential learning methods to better understand the…

A multitrait-multimethod study collected measures of social-cognitive flexibility, crystallized social knowledge, and academic problem solving from 169 high school seniors. Results support a division of social-cognitive intelligence into declarative and procedural social knowledge (crystallized) and flexible knowledge application as distinct from…

Agreement between two independent reviews of each of 278 manuscripts was compared on an overall recommendation and on specific rating items. Agreement between reviewers on separate dimensions, the unweighted sum of the dimensions, and various weighted sums was no better than that for the overall recommendation itself. (SLD)

Method effects as a source of construct invalidity were evaluated for parent, teacher, and child ratings of problem behaviors among 489 children and adolescents with serious emotional disturbances. Multitrait multimethod analysis indicated large method effects for each rater. Such effects may be measurement artifact, situational differences, or…

Compares holistic scoring of nonnative writing in English with multiple trait assessment and scoring. (JL)

Investigation of the use of a multiple-trait scoring procedure to obtain communicative writing profiles of adult nonnative English speakers found that the scoring method was highly reliable in composite assessment, but provided little psychometric support for assessing certain individual writing components. (28 references) (Author/CB)

Results of assessment with 34 children, 35 adolescents, and 40 undergraduates show that State of Mind (SOM) model ratios varied significantly depending on measurement method and self-versus-other condition, although age did not significantly influence SOM ratios, suggesting that the SOM model set point is applicable to children. (SLD)

The primary objective of this study was to examine the construct validity for the 2 multiple-content testing programs-the multiple-choice Comprehensive Tests of Basic Skills (CTBS/5) together with the performance-based Maryland School Performance Assessment Program (MSPAP)-by evaluating the true-score longitudinal associations among…

The No Child Left Behind (NCLB) Act of 2001 requires that public schools adopt research-supported programs and practices, with a strong recommendation for randomized controlled trials (RCTs) as the "gold standard" for scientific rigor in empirical research. Within that policy framework, this paper compares the relative utility of…

Two of the most widely used academic self-efficacy assessment techniques, problem-referenced measurement and the Motivated Strategies for Learning Questionnaire (MSLQ) were compared. Participants were 383 high school students from 4 Los Angeles (California) schools. Multi-trait multi-method analyses revealed that the two techniques were not…

Attempts an empirical integration of the constructs of needs, values, and preferences. Using data from postsecondary students (N=439), found that the Minnesota Importance Questionnaire Work Values Inventory, Values Scale, and Work Aspect Preference Scale all measure highly similar constructs. (Author/ABB)

Describes the application of a multimethod research approach to obtain data on students at a small college. Emphasizes the value of the multimethod/multitrait research strategy, also referred to as triangulation, or convergent methodology, where two or more methods, often qualitative and quantitative, are integrated to study the same variables.…

Several conceptual issues in the theory of evaluation methodology are discussed and illustrated. Four objectives are to: (1) narrow the distinction between research and evaluation; (2) extend the scope of triangulation and multimethods; (3) approach the problem concretely with extended data and interpretations; (4) structure the discussion in…

Reexamines a 49-year-old study of P technique applied to a psychotherapy patient with a recurrent physical symptom. Explores dimensions of psychotherapeutic change as well as the context for the recurrent symptom. Illustrates the contributions from applying the P technique to psychotherapy research, to psychosomatic medicine, and to personality…