What role can online communities play in meeting the informal learning needs of a professional association? This article presents the results of an interpretive study of the experiences of coordinators of Alberta Community Adult Learning Councils who participated in an online community of practice designed to support informal workplace learning.…

Concept mapping is a structured conceptualization that can be used by groups to develop a conceptual framework that guides evaluation or planning. Twelve papers discuss concept mapping in evaluation/planning in terms of theory development; measurement, construct validity, and pattern matching; outcome assessment and internal validity;…

This article describes the development of a multifaceted evaluation strategy to assess the effects of guaranteed subsidized child care on the subsequent attainment of welfare independence and aggregate welfare expenditures for Aid to Families with Dependent Children (AFDC). Advantages of a multimethod approach are discussed. (SLD)

Science process skills are described as a set of broadly transferable abilities, appropriate to all of the science disciplines and reflective of the true behavior of scientists. While science process skills have gained wide acceptance as an integral part of the science curricula, the development of valid and reliable instruments to assess those…

The construct validity of four self-concept (SC) traits (general SC, academic SC, English SC, mathematics SC), as measured by three different scales (Likert, semantic differential, Guttman) for low- (n=252) and high-track (n=588) Canadian high school students, was assessed using both the Campbell-Fiske criteria, and a comparison of hierarchically…

The advantages of applying confirmatory factor analysis (CFA) to multitrait-multimethod (MTMM) data are widely recognized. However, because CFA as traditionally applied to MTMM data incorporates single indicators of each scale (i.e., each trait/method combination), important weaknesses are the failure to: (1) correct appropriately for measurement…

Measures of 4traits (cognitive competence, social competence, social maladaption, and personal maladaption) were obtained on 157 persons with mental retardation, using 3 measurements: standardized assessment instrument, day shift staff ratings, and evening shift staff ratings. The multitrait-multimethod matrix procedure demonstrated strong…

The construct validity of 14 measures used in college faculty personnel decisions was evaluated through a multitrait-multimethod matrix for data from 89 faculty members in 7 departments. The three-pronged model of teaching, research, and service was not validated. Exploratory factor analysis identified five or six behavior domains for evaluation.…

This paper focuses on doctoral assessment as an area that has been relatively neglected in higher education research. It then describes and justifies a mixed-method approach to the study of PhD examination processes and outcomes in Australia. The design is reported of a study including candidate and candidature information for approximately 800…

Determines the level of drug and alcohol involvement of 369 middle and high school students and examines the effectiveness of early intervention. Results of the study underscore the frequency and seriousness of drug use, the need for more prevention efforts in elementary and middle schools, and additional treatment programs for high school…

In this study, the author tested the reliability, concurrent validity, and predictive validity of three hemispheric cognitive style instruments: (a) the Preference Test (PT; R. Zenhausern, 1978), (b) the Polarity Questionnaire (PQ; B. E. Morton, 2002), and (c) the Wagner Preference Inventory II (WAPI II; R. F. Wagner & K. A. Wells, 1985).…

The construct validity of children's responses to the Self Description Questionnaire, the Perceived Competence Scale for Children, and the Multidimensional Measure of Children's Perceptions of Control was assessed. The tests' authors emphasized the importance of distinguishing self-perceptions in the physical, social, academic, and general content…

Explores verbal exchange structure (2 people's cooccurring speech-act categories that accomplish some subtask within an interpersonal encounter) of two psychotherapeutic approaches used with 39 depressed clients. Analyzed verbal response mode frequencies in 1,630 segments. Exchanges showed distinctive temporal patterns across segments of sessions…

The construct validity of a multidimensional adolescent self-concept was estimated separately for males and females, and the results were compared across gender. The application of four multitrait-multimethod (MTMM) approaches to estimating construct validity was demonstrated, and the scope and consistency of the findings derived from each were…

The construct validities of the Self Description Questionnaire I, the Perceived Social Competence Scale, and the Multidimensional Measure of Children's Perceptions of Control were assessed, using 508 seventh through ninth graders in Sydney (Australia). Factor analysis, multitrait-multimethod analyses, and patterns of correlations with additional…